Tierra Blanca, Veracruz, Mexico
+8 years working in Data Management provided Data Integrations, Data Quality Solutions with Informatica Platform solutions to deliver just truly data. Performed ETL Migration initiatives with Informatica Power Center to connect different data sources as Databases, Flat Files, XML files to move into a data warehouse, Data marts, and created an automation process ETL to move data. Performed Data Quality initiatives with Informatica Data Quality to Discover, Develop, and Deploy data quality processes and integrate with Informatica Power Center in the ETL process. Discovery data with Informatica Analyst to create Profiling and scorecard to measure data quality and after create a process to enhance, standardized, match, and create a golden record.
Data Engineer working with Scrum methodology to develop and support data Pipelines for the data analysis team, Performing daily activities like: • Optimize data pipelines to reduce cost and time for SLA for Aws EMR and Databricks. • Perform analysis to reduce the storage cost(S3), moving cold data to the S3 archive and automizing a process to delete data after 7 days in the dev environment. • Develop airflow dags for internal data bricks rotation token every 30 days and update the token in all airflow clusters in a production environment. • Support data pipelines running with Apache airflow as an orchestrator, using Databricks and Aws EMR to the data processing to ingest data into a data warehouse in Hive and Snowflake. • Monitoring and optimizing pipelines to ingest data into snowflake tables. • Helping to design new Data Pipelines architecture and implementation using Kafka, Kubernetes, and Aws Services (RDS, S3, Lambda, CloudWatch) and PostgreSQL. • Creating a Python Module for the Climate Risk Platform and testing locally in Docker. • Perforce Code Review and implement best coding practices for the team. • Work directly with the Product Owner and Team Lead to create modules in Python for the MVP for the New Risk Scoring Engine Platform and estimate tasks. • Using Avro Schema as data serialization in Kafka. • Configure Aws alert for Kafka cluster and RDS Aurora cluster. • Team Lead for a small group of DE, perform 1:1, set goals, and set career path. • Mentor another team member in Python and Aws Knowledge. • Support with training and certifications to continue growing in the career path.
Developing data pipelines with Python and Aws Products(S3, Lambda, Athena, SNS, SQS, Cloud Formation, Cloud Watch). Migrate data from MongoDB, Mysql to S3. Call Rest API and integrate with Aws lambda. Deploying using serverless and Cloud formation. Agile Methodologies
Using Safe Agile Methodologies to the building of Data Lake with Aws, using components like S3, Lambda, Step Functions, Athena, SNS, CloudWatch. Using Python for the Pipelines for the ingestion and transformation of the data.
Working as Informatica Power Center developer and Data Quality developer to help to create ETL process and integrate with Data Quality flows using sources as Flat file and standardize data to move into Netezza Database * Developer Mapping and Workflows in Informatica Power Center. * Implementation and deployment of ETL process, * Automation of ETL process in Informatica Power Center * Data Quality process Developer with Informatica Data Quality. * Performance and best practices to ETL process * Shell Scripting Developer. *Safe Agile Methodologies
Informatica Power Center Platform Administrator, Monitored 365 days. Troubleshooting incidents with platform and workflows executions and Support Level 4. * Installations and configurations for Informatica Power Center Platform * Monitoring IPC platform. * MTI and MTP process. * ETL Developer * Support Lever 4. * Shell Scripting developer.
Data integrations Consultant provides solutions with Informatica Power Center, Informatica Data Quality and Informatica Identity Resolution and integrates with differences system and applications. Informatica Identity Resolution developer to implement process manage risk, detect fraud, ensure compliance with regulations against money laundering and enhance customer service Installation and configuration for Informatica Power center and Data Quality. Installation and configurations for Informatica Identity Resolution. ETL Developer with Informatica Power Center. Data Quality Developer with Informatica Data Quality. Search and match process Developer with Informatica Identity Resolution. Shell Scripting developer. Tableau Developer. Java Developer.