RESPONSIBILITIES:
Kforce has a client in Madison, WI that is seeking a Data Engineer who will play a crucial role in designing, implementing, and maintaining our data infrastructure. The Data Engineer will work with cutting-edge AWS technologies to build robust and scalable data pipelines, ensuring the integrity, quality, and availability of our data.Responsibilities:- Create and optimize ETL (Extract, Transform, Load) processes using AWS services such as Glue, S3, Lambda and Data Pipelines
- Develop scalable data architectures that support our microservice-based data ecosystem
- Utilize Terraform for infrastructure as code (IaC) to set up and manage resources
- Implement best practices in data modeling, ensuring efficient data structures
- Use PySpark and Python scripting for data transformation and enrichment
- Work with Glue crawlers to discover and catalog data sources
- Build and maintain Lambda functions for serverless data processing
- Leverage Glue jobs for data transformation and orchestration
- Utilize Glue catalog for metadata management
- Implement logging, monitoring, and alerting using AWS CloudWatch and other relevant tools
- Work with Delta Lake and Databricks for advanced analytics and data processing
- Query data stored in S3 data lakes using AWS Athena
- Interface with business stakeholders to gather requirements and deliver complete reporting solutions
- Collaborate with cross-functional teams to ensure data consistency and accuracy
- Stay updated with industry trends and emerging technologies related to data engineering
- Identify opportunities for process optimization and automation
REQUIREMENTS:
- Bachelor's degree in Computer Science, Information Systems, or a related field
- 3+ years of experience in data engineering, preferably with a focus on AWS technologies
- Proficiency in Python and PySpark
- Familiarity with Terraform for infrastructure provisioning
- Experience with Glue jobs, Lambda functions, and Glue crawlers
- Knowledge of Delta Lake, Databricks, and S3 data lake storage
- Strong problem-solving skills and attention to detail
- Excellent communication and teamwork abilities
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking "Apply Today" you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Get Hired Faster
Subscribe to job alerts and upload your resume!
*By registering with our site, you agree to our
Terms and Privacy Policy.
More Recruitment Consultancy jobs
|
|
|
|
|
|
Share diversity job
Data Engineer is posted on all sites within our Diversity Job Network.
