Role: Data Engineer
Company Name: Careerexpertoz
Location: Bangalore
Key Responsibilities:
Data Pipeline Development: Design, build, and maintain data pipelines that extract, transform, and load (ETL) data from various sources into data storage systems, such as data warehouses or data lakes.

Data Modeling: Create and manage data models and schemas that enable efficient storage and retrieval of data, ensuring data is structured for analysis.

Data Integration: Integrate data from a wide range of sources, including databases, APIs, and external data providers, to ensure data is accessible for analytics and reporting.

Data Transformation: Cleanse, transform, and enrich raw data to ensure it is consistent, accurate, and relevant for analysis. This may involve data normalization, deduplication, and data quality checks.

Data Storage: Choose appropriate data storage technologies and databases for different use cases, considering factors like data volume, velocity, and the nature of the data.

Data Quality Assurance: Implement data quality checks, validation rules, and error handling processes to ensure data accuracy and reliability.

Data Cataloging: Create and maintain a data catalog or metadata repository that documents data assets, schemas, and lineage to aid data discovery and governance.

Performance Optimization: Monitor and optimize data pipelines and storage systems for performance, scalability, and efficiency.

Security and Compliance: Implement data security measures, access controls, and compliance with data privacy regulations to protect sensitive information.

Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand their data requirements and provide data solutions to meet those needs.
Experience: 0 to 3 years
E-mail: info@careerexpertoz.com