Sr. Data Engineer 1

Apply now »

Date: Dec 2, 2023

Location: Bengaluru, KA, IN

Company: Skyworks

 

If you are looking for a challenging and exciting career in the world of technology, then look no further. Skyworks is an innovator of high performance analog semiconductors whose solutions are powering the wireless networking revolution. At Skyworks, you will find a fast-paced environment with a strong focus on global collaboration, minimal layers of management and the freedom to make meaningful contributions in a setting that encourages creativity and out-of-the-box thinking.  Our work culture values diversity, social responsibility, open communication, mutual trust and respect.  We are excited about the opportunity to work with you and glad you want to be part of a team of talented individuals who together can change the way the world communicates.

Requisition ID: 71684 

 

Job Description

  • Design, build, and maintain large-scale data processing pipelines using Azure data services (Azure Data Lake Storage, Azure Data Factory, Azure Stream Analytics, and others).
  • Implement data security and data privacy standards and practices to ensure the protection of sensitive data.
  • Implement automated data testing and quality assurance procedures to ensure data accuracy and completeness.
  • Develop and maintain data models and data marts for business reporting and analysis.
  • Work with the data science and analytics teams to support the deployment of predictive models and data-driven solutions.
  • Collaborate with cross-functional teams to understand data requirements and to recommend solutions that meet their needs.
  • Mentor and coach junior data engineers on best practices and emerging technologies.
  • Ability to work independently and analyze problems in the area of data engineering as well as analytics.
  • Responsibility for designing T/SQL routines that adhere to an enterprise data & information architecture.
  • Building and enhancing a metadata driven framework using Azure services - Data Factory, Synapse, SQL server, Data Lake Storage.
  • Creating data pipelines from scratch along the entire data chain: implementing data load patterns, error-handling, automated MDM procedures, data to hardware optimization, etc.
  • Takes ownership for resolving all data and information queries through to the source for our customers.
  • Review workloads and analyze resource requirements. Facilitate the development of effective Enterprise Data Platform requirements through a solid understanding of modern EDW tools, techniques, and best practices.
  • Evaluating data quality, consistency, and adherence to standards.
  • Construction of the Enterprise Data Platform requirements through a solid understanding of modern EDW tools, techniques, and best practices.
  • Enforce departmental operation procedures, applicable security practices, production policies and support need to ensure that the quality of service provided meets customer requirements.
  • Evaluate and recommend state-of-the-art development tools for use within the development ecosystem to achieve the most cost-effective, maximum-value solutions.
  • Provide functional, technical guidance and team mentoring.
  • Develop and update system/solution/process documentation associated with the database solution delivery.
  • Develop and update system/solution/process documentation associated with the data engineering solution delivery.
  • Work with colleagues to develop the IT strategy and supporting architecture.
  • Ensure solutions designs are aligned with appropriate policies, rules, standards.
  • Maintain the big picture perspective in the implementation of individual Data Engineering components.
  • Proactively identify and manage risks and issues.
  • Perform technical checkpoints with technical lead to ensure adequate quality assurance.
  • Challenge processes and behaviors to drive the adoption of lean processes.
  • Maintain up-to-date documentation of all procedures, infrastructure diagrams, system configuration and baseline standards, KPIs, implementation plans, system back out plans, system recovery plans, maintenance plans, system upgrades, and all other changes.
  • Good understanding of creating SOP, SOG documents. Experience with enhancing existing processes and its documentations.
  • Availability to support production issues off hours. Creating writeups with detailed RCA and action item.

Job Requirements

  • Bachelor's degree in Computer Science, Information Systems, or a related field. Master's preferred
  • 8+ years’ minimum of related experience
  • Deep knowledge of Azure Data & Analytics PaaS Services: Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB, Azure Stream Analytics, and Azure SQL DB
  • 4+ years of hands-on experience designing and implementing multi-tenant solutions including Azure platform for data governance, data pipelines for near real-time data warehouse, and machine learning solutions.
  • 4+ years of hands-on experience with data integration using ETL / ELT tools (e.g., SSIS, Azure Data Factory, Databricks)
  • Advanced knowledge of Python and an expert in data modeling
  • Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
  • Experience with data integration through APIs, Web Services, SOAP, and/or REST services
  • 4+ years of experience as a Data Engineer, with a focus on Azure data services.
  • Strong hands-on experience with Azure Data Lake Storage, Azure Data Factory, and Azure Stream Analytics.
  • Experience with SQL, Python, and Azure Functions.
  • Knowledge of big data technologies (such as Hadoop, Spark, and Hive) is a plus.
  • Strong understanding of data privacy and security best practices.
  • Excellent problem-solving skills and attention to detail.
  • Ability to work independently and in a team environment.
  • Good communication and interpersonal skills.
     

Skyworks is an Equal Opportunity Employer.  All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic protected by law.


Job Segment: Construction, Machinist, Computer Science, SQL, Quality Assurance, Engineering, Manufacturing, Technology