11+ Multithreading Jobs in Coimbatore | Multithreading Job openings in Coimbatore

Role Summary

As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible for assisting in the end-to-end analysis, development & maintenance of data pipelines and systems (DataOps). You will work closely with fellow data engineers & production support to ensure the availability and reliability of data for analytics and business intelligence purposes.

Requirements:

·      Around 4 years of working experience in data warehousing / BI system.

·      Strong hands-on experience with Snowflake AND strong programming skills in Python

·      Strong hands-on SQL skills

·      Knowledge with any of the cloud databases such as Snowflake,Redshift,Google BigQuery,RDS,etc.

·      Knowledge on debt for cloud databases

·      AWS Services such as SNS, SQS, ECS, Docker, Kinesis & Lambda functions

·      Solid understanding of ETL processes, and data warehousing concepts

·      Familiarity with version control systems (e.g., Git/bit bucket, etc.) and collaborative development practices in an agile framework

·      Experience with scrum methodologies

·      Infrastructure build tools such as CFT / Terraform is a plus.

·      Knowledge on Denodo, data cataloguing tools & data quality mechanisms is a plus.

·      Strong team player with good communication skills.

Overview Optisol Business Solutions

OptiSol was named on this year's Best Companies to Work for list by Great place to work. We are a team of about 500+ Agile employees with a development center in India and global offices in the US, UK (United Kingdom), Australia, Ireland, Sweden, and Dubai. 16+ years of joyful journey and we have built about 500+ digital solutions. We have 200+ happy and satisfied clients across 24 countries.

Benefits, working with Optisol

·      Great Learning & Development program

·      Flextime, Work-at-Home & Hybrid Options

·      A knowledgeable, high-achieving, experienced & fun team.

·      Spot Awards & Recognition.

·      The chance to be a part of next success story.

·      A competitive base salary.

More Than Just a Job, We Offer an Opportunity To Grow. Are you the one, who looks out to Build your Future & Build your Dream? We have the Job for you, to make your dream comes true.

Data Strategy and Planning:

Collaborate with stakeholders to develop and implement data management strategies aligned with business objectives.

Define data standards, policies, and procedures to ensure consistent and accurate data collection and storage.

Data Collection and Integration:

Identify and assess various data sources, both internal and external, to gather relevant and reliable data.

Design and implement data collection methods and processes to ensure data is captured efficiently.

Oversee data integration initiatives to consolidate data from different sources into a unified database.

Data Quality Assurance:

Develop and enforce data quality standards to ensure the accuracy, completeness, and consistency of data.

Implement data validation processes and routines to identify and rectify data discrepancies or errors.

Database Management:

Maintain and optimize data storage systems, including databases, data warehouses, and data lakes.

Ensure data security and compliance with relevant data protection regulations.

Data Analysis and Reporting:

Collaborate with analysts to provide clean and structured data for analysis.

Assist in creating data visualizations and reports to communicate insights and findings to stakeholders.

Team Collaboration:

Work closely with IT teams, data scientists, analysts, and other stakeholders to define data requirements and resolve technical issues.

Provide guidance and training to team members regarding data management best practices.

• Must have the experience of leading teams and drive customer interactions
• Must have multiple successful deployments user stories
• Extensive hands on experience in Apache Spark along with HiveQL
• Sound knowledge in Amazon Web Services or any other Cloud environment.
• Experienced in data flow orchestration using Apache Airflow
• JSON, XML, CSV, Parquet file formats with snappy compression.
• File movements between HDFS and AWS S3
• Experience in shell scripting and scripting to automate report generation and migration of reports to AWS S3
• Worked in building a data pipeline using Pandas and Flask FrameworkGood Familiarity with Anaconda and Jupyternotebook