Senior Data Engineer
Beacon Hill Staffing Group, LLC

One of our clients in Los Angeles is looking for a Senior Data Engineer with the following skills and experience:

Key Responsibilities:

• Develop, enhance, and maintain data pipelines within the Core Data platform, leveraging tools such as Airflow and Spark.
• Build robust tools and services to support data discovery, lineage, governance, and privacy compliance.
• Collaborate with cross-functional teams, including software engineers, data scientists, and product managers, to design and implement scalable solutions.
• Design and maintain APIs for seamless data integration and support downstream applications.
• Engineer real-time streaming data pipelines using technologies like Kafka and Delta Lake.
• Leverage modern tech stacks, including Snowflake, Databricks, and Graph Databases, to create innovative data solutions.
• Establish and document internal and external standards and best practices, focusing on data pipeline configurations and governance.
• Monitor and optimize the Core Data platform to ensure high reliability, accuracy, and adherence to SLAs.
• Participate in agile/scrum ceremonies to refine processes and enhance team efficiency.
• Maintain comprehensive documentation to support data quality, data governance, and operational transparency.
• Troubleshoot and resolve critical production issues promptly, including during off-hours when necessary.

Must-Have Skills and Qualifications:

1. Core Technical Expertise:
• Proficiency in data orchestration tools such as Airflow and distributed processing frameworks like Spark.
• Strong experience with Graph Databases and expertise in Snowflake or Databricks.
• Solid understanding of data modeling techniques and data warehousing best practices.
• Proficiency in at least one major programming language (e.g., Python, Java, Kotlin).
• Advanced SQL skills for querying and analyzing complex datasets.
2. Distributed Systems & Cloud Knowledge:
• Hands-on production experience with distributed data processing systems.
• In-depth understanding of cloud platforms like AWS and infrastructure-as-code practices.
3. Problem Solving & Communication:
• Strong algorithmic and analytical problem-solving skills.
• Excellent written and verbal communication, with the ability to collaborate across teams.
4. Real-Time and Streaming Experience:
• Experience with real-time event streaming technologies like Kafka is a plus.
5. Industry Experience (Preferred):
• Familiarity with production or content-related workflows is ideal.

Preferred Qualifications:

• Bachelor's degree in Computer Science, Information Systems, or equivalent industry experience.
• Familiarity with Agile and Scrum methodologies.
• Experience with OLTP vs. OLAP environments and their specific data handling requirements.

Interested candidates may submit their resumes online or call at 310-906-4780 for further information regarding the position.

Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.

If you would like to complete our voluntary self-identification form, please click here or copy and paste the following link into an open window in your browser: https://jobs.beaconhillstaffing.com/eeoc/

Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.

Company Profile:

Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.

Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.

Learn more about Beacon Hill and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting www.bhsg.com .

We look forward to working with you.

Beacon Hill. Employing the Future™

---