CG Infinity is hiring a Cloud Data Engineer for its Noida, Uttar Pradesh location. The position is intended for professionals with at least three years of hands-on experience in data engineering and cloud-based data platforms.
The successful candidate will design, implement, and manage scalable cloud data solutions, develop reliable data pipelines, optimise data storage and processing, and maintain data quality, security, and compliance. The role involves working with Microsoft Azure technologies, Databricks, Python, SQL, and modern data engineering practices to deliver reliable solutions for analytics and business requirements.
Key Responsibilities:
• Design, build, and maintain scalable data pipelines using modern cloud platforms.
• Develop robust ETL/ELT workflows for structured and unstructured data.
• Optimise data storage, query performance, partitioning, and data retrieval for large-scale datasets.
• Ensure data quality through validation checks, reconciliation, profiling, and automated monitoring.
• Collaborate with data analysts, business teams, data scientists, and other stakeholders to understand functional requirements.
• Implement data governance, metadata management, lineage tracking, and compliance standards.
• Build integrations with APIs, databases, and third-party platforms.
• Perform performance tuning for SQL queries, Spark jobs, and distributed data-processing workloads.
• Develop reusable frameworks, coding standards, and CI/CD pipelines for data engineering solutions.
• Collaborate with cross-functional teams to design, develop, and deliver scalable data solutions.
• Conduct continuous performance tuning, optimisation, and capacity planning for data platforms and pipelines.
• Integrate LLM and Generative AI solutions with enterprise data sources using secure data pipelines.
• Evaluate emerging AI data tools and recommend improvements to modern data platforms.
• Build and maintain data pipelines for AI/ML use cases, including feature engineering and model-ready datasets.
• Support the deployment of AI-powered analytics, recommendation systems, and predictive solutions.
• Provide training, documentation, and ongoing support to end users and internal stakeholders.
Required Skills and Qualifications:
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• At least three years of hands-on experience in data engineering and cloud-based data platforms.
• Strong experience with Microsoft Azure technologies, including Azure Data Factory, Azure SQL, CI/CD pipelines, and cloud infrastructure.
• Experience with ARM Templates and Terraform for infrastructure management and automation.
• Hands-on experience with Databricks for data engineering, ETL pipelines, and big data processing.
• Strong Python programming skills and logical problem-solving abilities.
• Advanced SQL skills.
• Understanding of data warehousing, data lake, and Lakehouse architectures.
• Experience with ETL/ELT tools, data integration, and pipeline orchestration.
• Knowledge of database design, data modelling, and performance optimisation.
• Understanding of data security, access controls, encryption, and compliance practices.
• Knowledge of data governance, metadata management, lineage, and data quality frameworks.
• Experience with Git and collaborative software development workflows.
• Familiarity with monitoring, alerting, and logging tools for production systems.
• Knowledge of Apache Spark and distributed data processing is preferred.
• Exposure to AI/ML data pipelines, feature engineering, and modern analytics solutions is an advantage.
• Familiarity with LLMs, Generative AI, vector databases, or RAG-based solutions is beneficial.
Benefits:
• Five-day working week.
• Competitive salary.
• Flexible working hours.
About CG Infinity:
CG Infinity is a technology consulting and software services company headquartered in Texas, with operations in India. The company provides customer experience and CRM solutions, application development and integration, production support, quality assurance, and data analytics and AI services.
This opportunity is suited to data engineering professionals who can build secure, scalable data pipelines and support modern cloud data platforms, enterprise analytics, and AI-driven applications.
Benefits will be discussed during interview.
CG Infinity is a technology consulting and digital transformation firm founded in 1998 and headquartered in Plano, Texas. The company works with enterprises, particularly in energy and utilities and financial services, to deliver technology solutions... Read More
