Sunrise System Inc. is currently seeking Expert Data Engineer - W2 Contractor in Hillsboro, OR for one of our top clients.
Title: Expert Data Engineer - W2 Contractor Location Hillsboro, OR 97123 Type: Contract W2 only Duration: 6+ months ID # 16-14909
Job Description Core responsibilities:
Expert data engineers will work with product teams to help automate and integrate several of data domains with a wide variety of data profiles (different scale, cadence, and volatility) into next-gen data and analytics platform.
This is an opportunity to work across multiple subject areas and source platforms to ingest, organize, and prepare data through cloud-native processes.
5+ years of professional development experience between either Python (preferred) or Scala/Java; familiarity with both is ideal
5+ years of data-centric development with a focus on efficient data access and manipulation at multiple scales ( 1TB)
3+ years of experience with the HDFS ecosystem of tools (any distro, Spark experience prioritized)
3+ years of significant experience developing within the broader AWS ecosystem of platforms and services
3+ years of experience optimizing data access and analysis in non-HDFS data platforms (Traditional RDMS's, NoSQL / KV stores, etc)
Direct task development and/or configuration experience with a remote workflow orchestration tool - Airflow (preferred), Amazon Data Pipeline, Luigi, Oozie, etc.
Intelligence, strong problem-solving ability, and the ability to effectively communicate to partners with a broad spectrum of experiential backgrounds
Several of the following skills are also desired:
A demonstrably strong understanding of security and credential management between application / platform components
A demonstrably strong understanding of core considerations when working with data at scale, in both file-based and database contexts, including SQL optimization
Direct experience with Netflix Genie is another huge plus
Prior experience with the operational backbone of a CI/CD environment (pipeline orchestration + configuration management) is useful
Clean coding practices, passion for development, being a generally good team player, etc, etc (and experience with GitHub) is always nice
Apply on-line for immediate consideration, please send your updated resume and contact info via