Data Engineer Job Description
所在版块:创业求职 发贴时间:2017-06-02 00:42

用户信息
复制本帖HTML代码
高亮: 今天贴 X 昨天贴 X 前天贴 X 
RESPONSIBLITIES
Because we work on the cutting edge of a lot of technologies, we need someone who is a creative problem solver, resourceful in getting things done, and productive working independently or collaboratively. This person would also take on the following responsibilities:
1 Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
2 Work closely with our engineering team to integrate your amazing innovations and algorithms into our production systems.
3 Perform ETL for various datasets with complex data transformation logic in batches as well as in real-time
4 Build scalable search and indexing capability to navigate and retrieve data
5 Process unstructured data into a form suitable for analysis – and then do the analysis.
6 Support business decisions with ad hoc analysis as needed.

DESIRED SKILLS
1 Programming experience, ideally in Python or Scala, but we are open to other experience if you’re willing to learn the languages we use.
2 Hands-on Experience in data modeling and data model optimization
3 Deep knowledge and hands on experience in ETL into and from RDBMS, preferable with PostgreSQL and Oracle DB.
4 Experience with open-source ETL tools such as Pentahol and Talend is a plus
5 Proficient in writing SQL queries
6 Experience processing large amounts of structured and unstructured data. Spark and MapReduce experience is a plus.
7 Excellent programming knowledge to clean and scrub noisy datasets.
8 Deep knowledge in data mining, machine learning, natural language processing, or information retrieval is a plus
9 Strong knowledge of and experience with statistics; potentially other advanced math as well.
10 An excellent team player and communicator who can work effectively with cross functional teams.
.
欢迎来到华新中文网,踊跃发帖是支持我们的最好方法!

 相关帖子 我要回复↙ ↗回到正文
公司招数据工程师,软件工程师 向往新生活   (105 bytes , 2404reads )
Principal Architect JD 向往新生活   (3287 bytes , 115reads )
公司另找软件工程师,有意者请短信我。 向往新生活   (2549 bytes , 108reads )
您好 Melt   (168 bytes , 101reads )
更新下,如果是PR或公民会有更好的机会 向往新生活   (0 bytes , 87reads )
已私信 pto   (5 bytes , 78reads )
国王大道   (5 bytes , 85reads )
已私信 阿牛ge   (58 bytes , 76reads )
公司不错! Will_Gao   (33 bytes , 71reads )
Senior Software Engineer Job Description 向往新生活   (1088 bytes , 117reads )
Data Engineer Job Description 向往新生活   (1815 bytes , 183reads )