Ashish Sinha
Krakow
Summary
Thrive on challenging tasks on any environment, highly organized and dedicated with a positive attitude towards my role. Having more than 6 years of IT Experience in Data ingestion, transformation, and Integration Pipeline and a certified AWS Developer. Accomplished engineer proffering extensive cloud deployment and data engineering skills. Defined, built and maintained infrastructure using vendor-neutral and platform-specific tools. Organized and focused person with extraordinary leadership acumen.
Overview
6
6
years of professional experience
4
4
Certification
2
2
Languages
Work History
Senior Data Engineer
Epam Systems
Krakow, Poland
09.2022 - Current
- Participated and handled stand up calls, retro and team board meetings
- Handled AWS Data pipeline with the use cases provided
- Created data pipeline orchestration on AWS to handle the migration to snowflake
- Followed data Vault techniques in snowflake warehouse for migration using DBT and SQL
- Designed and Implemented the Initial load of the data using AWS Serverless and container services
- Proposed a security best practices over the existing dbt jobs, using AWS serverless services and Terraform as a IaC
- Led a team of 10 and provided data integration solutions for team and for the client.
- Optimized data pipelines by implementing advanced ETL processes and streamlining data flow.
- Collaborated with cross-functional teams to define requirements and develop end-to-end solutions for complex data engineering projects.
- Mentored junior team members in best practices for software development, code optimization, and troubleshooting techniques.
- Spearheaded efforts to migrate legacy systems onto cloud-based platforms, resulting in improved scalability and costefficiency.
- Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
- Participated in strategic planning sessions with stakeholders to assess business needs related to data engineering initiatives.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Prepared written summaries to accompany results and maintain documentation.
- Built table structures for snowflake schema using DBT.
Senior Data Engineer
Larsen & Toubro Infotech
Bengaluru, India
04.2021 - 08.2022
- Was part of Data Integration MDM development team, developed ETL pipelines
- Handled CSV and Json data (history and live data) using s3 Data Lakes
- Used Pyspark /python for cleaning and standardization of data
- Data transformation and Data migration to AWS document dB
- Implemented data ingestion and integration flow using AWS and python
- Lead the manual testing team and cloud team as well
- Designed and implemented effective database solutions and models to store and retrieve data.
- Compiled, cleaned and manipulated data for proper handling.
- Analyzed large datasets to identify trends and patterns in customer behaviors.
- Used AWS services like Glue, AWS Batch, S3, lambda, CloudWatch, Step function for data pipeline developement
- Created data pipeline flow for data migration.
Senior Software Engineer (AWS developer)
Mindtree
Bengaluru, India
03.2020 - 03.2021
- Orchestrated the flow of a Machine learning models using Aws Step Function
- Designed secure cloud architectures with a focus on data protection, incorporating AWS security best practices and tools.
- Streamlined deployment processes using AWS CodePipeline and CodeDeploy, reducing time to market for new features.
- Collaborated with stakeholders to gather requirements, translating business needs into technical specifications for AWS solutions.
- Assisted in the development of comprehensive disaster recovery strategies using AWS tools such as S3, ensuring seamless failover capabilities and minimizing potential data loss.
- For heavy workloads or long running workloads used Aws Batch for running the algorithm and scripts
- Used Serverless AWS Serverless services to build data pipeline like lambda, step function, glue, S3
- Did a python scripting in lambda and worked for an event-based scenario connected to s3 and Event Bridge
- Exposed API through Aws API gateway
- Provided the solution for using Aws Dynamo DB as Database as per client requirement and implemented as per need.
- Leveraged AWS Lambda functions for serverless computing, reducing operational costs while increasing scalability.
Senior Software Engineer
Capgemini
Bengaluru, India
03.2018 - 03.2020
- Developed enterprise-level applications for Disney Carnival Cruise lines
- Worked towards meeting the client requirements
- Worked on analysing the client data manually
- Involved in the deployment of application on AWS
- Analysing the code quality using sonar report
- Aws management for managing the application and deployment to cloud
- AWS CICD for continuous integration and development.
- Developed scalable applications using agile methodologies for timely project delivery.
- Maintained comprehensive documentation of development work, facilitating knowledge sharing among team members.
Software Intern
Tata Steel
Jamshedpur ,India
08.2017 - 03.2018
- Worked for a tata steel payment product, migration to cloud.
- Participated in code reviews with experienced developers, gaining valuable insights into best practices and refining personal coding techniques.
- Developed reports using SQL server reporting services.
- Created proofs of concept for innovative new solutions.
Freelancer
NEXTGEN SOLUTIONS
Jamshedpur, India
08.2017 - 03.2018
- Worked as Data solution provider and a AWS Developer
Education
Master of Science - Artificial Intelligence
Liverpool John Moores University
Liverpool, London06.2024
Bachelor of Science - Computer Science
College of Engineering
Bhubhaneswar, India07.2017
High School Diploma -
Computer Science S.D.S.M School For Excellence
Jamshedpur, India03.2013
Skills
- AWS Serverless services( lambda, s3, stepfunction, Eventbridge etc )
- AWS Container services( Ecs, aws Batch )
- AWS ETL services( Glue, Emr )
- Continuous Integration and deployment
- Data Integration ,transformation and engineering
- Python(core, pandas ), Pyspark
- Boto3, machine learning
- Mysql, Dynamodb
- Github , Github action
- Visual studio code , linux
- Docker Desktop, Pycharm
Certification
- AWS Developer Associate, AWS
- IBM Data Science professional Certification, IBM
- Hands-On Essentials: Data Warehousing Workshop, snowflake
- Python for data analysis, Coursera
Personal Information
Title: Senior Data Engineer
Timeline
Senior Data Engineer
Epam Systems
09.2022 - Current
Senior Data Engineer
Larsen & Toubro Infotech
04.2021 - 08.2022
Senior Software Engineer (AWS developer)
Mindtree
03.2020 - 03.2021
Senior Software Engineer
Capgemini
03.2018 - 03.2020
Software Intern
Tata Steel
08.2017 - 03.2018
Freelancer
NEXTGEN SOLUTIONS
08.2017 - 03.2018
Master of Science - Artificial Intelligence
Liverpool John Moores University
Bachelor of Science - Computer Science
College of Engineering
High School Diploma -
Computer Science S.D.S.M School For Excellence