Director - Data Engineering - Wikia, Inc. - San Francisco

Job description
Are you a leader in Data Engineering who is bored working with million row data sets? Would you love to be in charge of building a brand new data warehouse for a top 20 website? How does this sound? We’re one of the largest websites in the world and we’d like you to take the lead on managing our data. With 1.8 billion pageviews a month and a data warehouse of over 13TB, the role of Director of Data Engineering opens you to a vast, growing, dynamic social universe.
We want you to help us better understand and serve the biggest, most knowledgeable fans on the planet. Responsibilities Understand business needs and translate to data requirements Enhance and maintain our current Data Warehouse and ETL infrastructure Lead the design and implementation of our new Data Warehouse & ETL infrastructure Perform ad-hoc SQL-based analysis against MySQL & PostgreSQL data warehouses Translate analysis results into digestible tabular or graphical reports Requirements Experience maintaining and using relational databases(MySQL, PostgreSQL, Oracle, etc.) Experience building Hadoop systems and migrating data into them Strong knowledge of Hadoop components and how they work together (Hive, HBase, Oozie, Sqoop, Impala, etc) Knowledge of Dimensional modeling and performant data loading strategies Scripting experience (preferably Perl/Python and bash) Grasp of basic statistics concepts Self-starter with appropriate attention to detail 2-5 experience managing engineers 5-10 years of web-based software engineering, preferably some using PHP BS Computer Science or equivalent Bonus points if you...

Have experience wrangling terabyte-sized datasets Know the R statistical package Have implemented Tableau or MicroStrategy (we use Tableau) Set up lambda architecture-based systems (eg Storm) Have experience with Amazon EC2 and EMR Like our fans, Wikia is collaborative, high-energy, and passionate. Wikia is a Quantcast Top 20, ComScore Top 100, and Nielsen Top 10 Social Media Site. We are often cited as the official source of fan-authored content on topics driving our global culture. Over 130 million unique visitors come to Wikia each month, from mobile and desktop alike. Our exciting fan platform is going to introduce great career challenges for you but is also coupled with a culture that emphasizes strong work life balance. For your expertise, we will offer a competitive salary, stock options, and full benefits.

Enter your email address:

Refer This Job To Your Friends And Help Them To Find Jobs!