Data Scientist

Job Description

Data Scientist

• Develop and maintain data pipelines for processing large datasets using

Python and relevant libraries such as Pandas and NumPy.

• Parse log files and other data sources to extract relevant information and

insights.

• Connect to various databases and APIs to fetch, manipulate and store data

as required.

• Design and develop efficient data structures and algorithms for data

processing, cleaning, and analysis.

• Lead projects end-to-end, and collaborate with cross-functional teams,

including data scientists, analysts, and product managers.

• Write clean, maintainable, and scalable code, with a strong emphasis on

testing and documentation.

• Set up and manage scheduling tools, such as Airflow, to automate data

processing tasks.

• Continuously improve the efficiency and effectiveness of data pipelines, by

identifying and implementing best practices and new technologies.

• Ensure code is version-controlled and collaborate with other team

members using Git.