Big Data Engineer
Hello There,
My name is Himanshu Sharma , and I serve as the Recruitment Lead at Kanak-IT INC. I am reaching out to share an excellent career opportunity for the role of Big Data Engineer with our esteemed client. If you are interested then please share your updated resume at [email protected] .
Job Description
Position : Big Data Engineer
Location : Malvern, PA Hybrid
Duration : Initial 12 months + options to extend - Long term contract role
Responsibilities
- Collaborate on the Smartstream cash reconciliation platform, known as TLM, to support data integration and transformation workflows.
- Design and implement ETL processes using tools like AWS Glue, Spark, or Python to transform raw data into structured formats compatible with Smartstream's ingestion requirements.
- Conduct data mapping exercises to align legacy data structures with modernized attributes stored in S3 buckets, ensuring consistency and accuracy across systems.
- Ensure data quality and lineage through validation checks, anomaly detection, and documentation of data assumptions
- Integrate data sources into cloud platforms such as AWS, leveraging services like S3, Glue, Lambda
- Work closely with product owner and business to understand data requirements, translate them into technical specifications
- Implement data governance principles, including version control, access management, and compliance with Vanguard and GIFS standards
Qualification: (8+ minimum experience)
- AWS Skills - Glue Lambda S3 KMS Stepfunctions General Skills - Data Transformation Tools like Pandas and Pyspark Cloudformation Cloudblocks Python Bitbucket/Github Coder (optional) Java (optional) Golang (optional) Cobol/JBL (optional)
Recommended Jobs
Farm Manager
Farm Manager (6374) Location: State College, Pennsylvania Job Number: 6374 Mission: Windswept Farm is the home of RE Farm Café in Centre County Pennsylvania. RE Farm Café offers a unique din…
Resident Assistant
Job Description Job Description Goodwill of Southwestern Pennsylvania is a nonprofit organization that funds job training, education, and other community programs by selling donated clothing and …
Youth Soccer Coach Pittsburgh South
Job Description Job Description Benefits: ~ Employee discounts ~ Free uniforms ~ Training & development ~ Company parties ~ Paid time off ~401(k) matching ~ Opportunity for advancem…
Assoc. Spclst, Engineering
Are you looking for an exciting opportunity with a rapidly growing pharmaceutical manufacturer? If so, then this is the opportunity for you! Our Engineers support internal and external manufactur…
Explore Philadelphia: Deliver Dreams in the City of Brotherly Love!
Registered Nurse - Labor & Delivery - Travel - (LD RN) Join the vibrant nursing community in Philadelphia as a Labor and Delivery RN! Starting September 15, 2025, immerse yourself in the “City of Bro…
MGR II R&D/PRODUCT DVL ENGINEERING
At TE, you will unleash your potential working with people from diverse backgrounds and industries to create a safer, sustainable and more connected world. Job Overview TE Connectivity’s R&D…
Data Engineer (AWS, Azure, GCP)
CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do and the re…
Speech Language Pathologist- Clinical Fellow (SLP-CF)
Job Description Job Description Job Title: Speech Language Pathologist- Clinical Fellow (SLP-CF) Location: Philadelphia, PA Employment Type : Full-Time (Monday to Friday) Salary: Based …
Principal Electrical Systems Engineer
At TE, you will unleash your potential working with people from diverse backgrounds and industries to create a safer, sustainable and more connected world. Job Overview TE Connectivity’s Off…
Motorcycle Sales Associate/Fit Specialist
Job Description Job Description Job Title: Fit Specialist Department : Motorcycle Sales Supervisor: Sales Management Team Summary Description Focus on the in-store customer exper…