Abintio Data Engineer

Envision Technology Solutions · Berkeley Heights, New Jersey

FULL TIME

Job Description

Job Title : Data Engineer Ab initio

Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and aggregations.
Implement event-driven data pipelines using Kafka, MQ, and file streams.
Ensure the resilience of continuous flows, including checkpointing and recovery, to guarantee \"exactly-once\" processing.
Apply advanced Ab Initio components (e.g., Reformat, Rollup, Join, Partition) to ensure low-latency performance.
Proactively monitor live production streams to ensure 24/7 reliability and troubleshooting data issues
Develop ETL pipelines for batch and real-time data ingestion and transformation.
Implement and ensure data validation, data security, integrity, and compliance across big data platforms.
Monitor and troubleshoot performance issues in large-scale clusters.
Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.
Automate workflows and improve operational efficiency using scripting and orchestration tools.

Deep understanding of credit card process system
Deep knowledge of GDE (Graphical Development Environment), EME (Enterprise Meta>Environment), Conduct>It, and Continuous Flows.
Understanding of Kafka, message queues, and real-time stateful services.
Proficiency in Unix/Linux shell scripting, SQL, and database technologies (e.g., Oracle, Teradata).

Company	Envision Technology Solutions
Location	Berkeley Heights, New Jersey
Type	FULL TIME
Niche	Full-time