Why TrueML?
TrueML is a mission-driven monetary software program firm that goals to create higher buyer experiences for distressed debtors. Shoppers right this moment need private, digital-first experiences that align with their existence, particularly with regards to managing funds. TrueML’s method makes use of machine studying to have interaction every buyer digitally and alter methods in actual time in response to their interactions.
The TrueML group consists of impressed information scientists, monetary providers trade consultants and buyer expertise fanatics constructing know-how to serve individuals in a manner that acknowledges their distinctive wants and preferences as human beings and endeavoring towards guaranteeing no one will get locked out of the monetary system.
In regards to the Position:
As a Senior Information Engineer II, you’ll play a pivotal function in designing, constructing, and sustaining our cutting-edge information LakeHouse platform. You’ll leverage open desk codecs like Apache Iceberg to create scalable, dependable information options that allow optimized question efficiency throughout a broad spectrum of analytical workloads and rising information functions. On this function, you may develop and function strong information pipelines, integrating various supply techniques and implementing environment friendly information transformations for each batch and streaming information.
Work-Life Advantages
- Limitless PTO
- Medical profit contributions in congruence with native legal guidelines and kind of employment settlement
What you may do:
- Constructing Information LakeHouse: Within the Senior Information Engineer II function, you’ll design, construct, and function strong information lakehouse options using open desk codecs like Apache Iceberg. Your focus shall be on delivering a scalable, dependable information lakehouse with optimized question efficiency for a variety of analytical workloads and rising information functions.
- Pipeline and Transformation: Combine with various supply techniques and assemble scalable information pipelines. Implement environment friendly information transformation logic for each batch and streaming information, accommodating varied information codecs and buildings.
- Information Modeling: Analyze enterprise necessities and profile supply information to design, develop, and implement strong information fashions and curated information merchandise that energy reporting, analytics, and machine studying functions.
- Information Infrastructure: Develop and handle a scalable AWS cloud infrastructure for the info platform, using Infrastructure as Code (IaC) to reliably assist various information workloads. Implement CI/CD pipelines for automated, constant, and scalable infrastructure deployments throughout all environments, adhering to finest practices and firm requirements.
- Monitoring and Upkeep: Monitor information workloads for efficiency and errors, and troubleshoot points to take care of excessive ranges of knowledge high quality, freshness, and adherence to outlined SLAs.
- Collaboration: Collaborate intently with Information Companies and Information Science colleagues to drive the evolution of our information platform, specializing in delivering options that empower information customers and fulfill stakeholder wants all through the group.
A profitable candidate can have:
- Bachelor’s diploma in Pc Science, Engineering, or a associated technical discipline (Grasp’s diploma is a plus).
- 5+ years of hands-on engineering expertise (software program or information), with a powerful emphasis on 3+ years in data-focused roles.
- Expertise implementing information lake and information warehousing platforms.
- Sturdy Python and SQL abilities utilized to information engineering duties.
- Proficiency with the AWS information ecosystem, together with providers like S3, Glue Catalog, IAM, and Secrets and techniques Supervisor.
- Expertise with Terraform and Kubernetes.
- Monitor report of efficiently constructing and operationalizing information pipelines.
- Expertise working with various information shops, significantly relational databases.
You may additionally have:
- Expertise with Airflow, DBT, and Snowflake.
- Certification in related applied sciences or methodologies.
- Expertise with streaming processing know-how, e.g., Flink, Spark Streaming.
- Familiarity with Area-Pushed Design ideas and event-driven architectures.
- Certification in related applied sciences or methodologies.
This function is simply authorized to rent inside the following LatAm international locations: Mexico, Argentina, or Dominican Republic.
We’re a dynamic group of people who find themselves material consultants with a ardour for change. Our groups are crafting options to huge issues each day. For those who’re in search of a chance to do impactful work, be part of TrueML and make a distinction.
Our Dedication to Variety & Inclusion
TrueML is an equal-opportunity employer. We promote, worth, and thrive with a various & inclusive group. Completely different views contribute to higher options, and this makes us stronger each day. We don’t discriminate on the idea of race, faith, coloration, nationwide origin, gender, sexual orientation, age, marital standing, veteran standing, or incapacity standing.