Big Data Engineer
Job Description
We are
At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,500+, and has 58 offices in 21 countries within key global markets.
Our challenge
We are looking for a highly skilled and experienced Senior Big Data Engineer with over a decade of expertise in building large-scale data solutions utilizing Hadoop and Spark ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing complex data processing architectures to enable advanced analytics, machine learning, and reporting platforms.
Additional Information*
The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Charlotte, NC is $100k - $110k/year & benefits (see below).
The Role
Responsibilities:
Design, develop, and optimize big data pipelines and processing frameworks using Hadoop (HDFS, MapReduce, YARN) and Apache Spark.
Build scalable data ingestion processes and data lakes for diverse data sources.
Develop and maintain ETL workflows that handle processing of structured and unstructured data.
Collaborate with Data Scientists, Analysts, and Business Teams to translate requirements into technical solutions.
Tune and troubleshoot Spark and Hadoop jobs for maximum efficiency and performance.
Implement data security, privacy, and compliance best practices across all platforms.
Mentor junior team members and foster best practices in big data development.
Stay current with emerging trends and technologies related to Hadoop and Spark.
Document architecture, workflows, and standards for maintainability and knowledge sharing.
Requirements:
Bachelor’s, Master’s, or Ph.D. in Computer Science, Information Technology, or related field.
10+ years of industry experience in big data engineering with proven expertise in Hadoop and Spark technologies.
Extensive experience with Hadoop ecosystem components: HDFS, MapReduce, YARN, Hive, Pig, HBase, and Oozie.
Strong proficiency in Apache Spark (Scala, Python, or Java) and Spark SQL.
Experience with data ingestion tools such as Apache NiFi, Kafka, or Flume.
Hands-on experience with cloud platforms (AWS, Azure, GCP) and their big data services integrated with Hadoop/Spark.
Knowledge of data modeling, data warehousing, and database technologies (NoSQL, relational systems).
Familiarity with containerization and orchestration tools like Docker and Kubernetes.
Familiar with data governance, security, and compliance standards.
Excellent problem-solving, system architecture, and communication skills.
Preferred, but not required:
Experience with Spark Streaming and real-time data processing.
Knowledge of advanced analytics, machine learning pipelines, and integration with Spark MLlib.
Experience with automation and orchestration tools such as Apache Airflow.
Familiarity with version control and CI/CD practices for big data platforms.
We offer:
A highly competitive compensation and benefits package.
A multinational organization with 58 offices in 21 countries and the possibility to work abroad.
10 days of paid annual leave (plus sick leave and national holidays).
Maternity & paternity leave plans.
A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region).
Retirement savings plans.
A higher education certification policy.
Commuter benefits (varies by region).
Extensive training opportunities, focused on skills, substantive knowledge, and personal development.
On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms.
A flat and approachable organization.
A truly diverse, fun-loving, and global work culture.
SYNECHRON’S DIVERSITY & INCLUSION STATEMENT
Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.
All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.
Company Information
Location: New York, NY
Type: Hybrid