Big Data Engineer - Data Engineer
Micron
Taichung, TXQ, TW
17天前

JobDescription

As a Data Engineer at Micron,

you will be a key member of a cross-functional team responsible for developing

and growing Micron’s IoT methods

and systems for extracting new insight for our expanding data streams.

You will be collaborating with Data Scientists, Engineers, Technicians teams to design

and implement systems to extract data from different data warehouses

and transforming it into an actionable format.

You will need to creating new solutions, as well as, supporting, configuring, and enhancing existing solutions.

Responsibilities and Tasks

Understand the Business Problem and the Data that is Relevant to the Problem

Maintain an intimate understanding of company and department strategy

Translate analysis requirements into data requirements

Identify and understand the data sources that are relevant to the business problem

Develop conceptual models that capture the relationships within the data

Define the data-quality objectives for the solution

Be a subject matter expert in data sources and reporting options

Architect Data Management Systems

Leverage understanding of the business problem and the nature of the data to select appropriate data management system (Big Data, OLTP, OLAP, etc.)

Design and implement optimum data structures in the appropriate data management system (Hadoop, Teradata, SQL Server, etc.

to satisfy the data requirements

Plan methods for archiving / deletion of information

Develop, Automate, and Orchestrate an Ecosystem of ETL Processes that is Fast and Reliable for Varying Volumes of Data

Identify and select the optimum methods of access for each data source (real-time / streaming, delayed, static)

Determine transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical data model

Develop processes to efficiently load the transform data into the data management system

Prepare Data to Meet Analysis Requirements

Work with the Data Scientist to implement strategies for cleaning and preparing data for analysis (e.g., outliers, missing data, etc.)

Develop and code data extracts

Follow best practices to ensure data quality and data integrity

Ensure that the data is fit to use for data science applications

Required Skill

Experience with one or more high-level client, object-oriented language (e.g., C++, JAVA, Scala, Python, etc.).

Experience with big data processing and / or developing applications and data sources via Hadoop

Be familer with HBASE, Hive, Kafka would be bonus

We recruit, hire, train, promote, discipline and provide other conditions of employment without regard to a person's race, color, religion, sex, age, national origin, disability, sexual orientation, gender identity and expression, pregnancy, veteran’s status, or other classifications protected under law.

This includes providing reasonable accommodation for team members' disabilities or religious beliefs and practices.

Each manager, supervisor and team member is responsible for carrying out this policy. The EEO Administrator in Human Resources is responsible for administration of this policy.

The administrator will monitor compliance and is available to answer any questions on EEO matters.

To request assistance with the application process, please contact Micron’s Human Resources Department at 1-800-336-8918 (or 208-368-4748).

Keywords : Taichung Taichung (TW-TXQ) Taiwan (TW) Quality College Regular Engineering Not Applicable

申請
添加至收藏
從收藏夾中刪除
申請
郵箱地址
通過點擊“繼續”,我允許neuvo同意處理我的數據並向我發送電子郵件提醒,詳見neuvo的 隱私政策 。我可以隨時撤回我的同意或退訂。
持續
申請表