PROFILE SUMMARY
Results-driven Data Engineer with 11 years of experience in technology, including 5 years in designing, developing, and optimizing data pipelines and ETL workflows, and 6 years as a Database Administrator and Full Stack Web Developer, along with 3+ years specializing in generative AI solutions. Proven expertise in developing cutting-edge AI systems such as large language models (LLMs), image synthesis tools, and AI-powered applications. Adept at building scalable data solutions with a strong foundation in data architecture, cloud technologies, and big data processing. Certified in Databricks for Apache Spark, with demonstrated expertise in transforming complex data into actionable insights to drive business decisions.
Education and Qualifications
2012 - Master of Computer Application
Pt. Ravishankar Shukla University, Raipur (C.G.), INDIA
2009 - Bachelor of Computer Application
Guru Ghashi Das University, Bilaspur(C.G.), INDIA
Certification
Databricks Certified Data Engineer Professional
(issued: June 23, 2025)
Databricks Certified Data Engineer Associate
(issued: August 2024)
Current Position
Fortune 100 Company (Confidential),
January 2024 – Present
Duties:
- Collaboration: Worked closely with data scientists and analysts to integrate predictive models into data workflows, enabling real-time analytics.
- Data Integration: Developed complex ETL processes that integrated data from multiple sources, including relational databases, APIs, and unstructured data.
- Data Quality Assurance: Conducted data quality checks to ensure data integrity, which reduced errors in downstream
- Designed and implemented a global ticket and incident data pipeline, integrating multiple data sources into a centralized SQL Server database.
- Developed a robust semantic model to connect SQL Server with Power BI, enabling business users to perform self-service analytics.
- Authored complex DAX scripts to support dynamic reporting, KPIs, and data transformations in Power BI.
- Built data models to support retail shop analytics, including multiple sales attribution models such as First-Touch and Last-Touch, to help measure campaign effectiveness and customer journey insights.
Past Positions
BS Fintech Private Limited, Bangalore as Data Engineer,
February 2023 – December 2023
Duties:
- To create a pipeline for extracting data of potential customers for credit cards, bank accounts, and loans, I have built a pipeline using AWS S3, Databricks and PySpark.
- Designed the data pipeline architecture for a top financial advisor every month.
- Optimize database systems for performance efficiency.
- Perform space management and capacity planning for database systems.
- Creating complex functions, scripts, stored procedures, and triggers to support application development.
National Informatics Centre Services Inc. (NICSI), Raipur as Data Engineer,
April 2019 – January 2023
Duties:
- I created a pipeline to consolidate data from the Food Department, Land Records Department, and Agriculture Department based on certain conditions. This resulted in useful for transfer of funds into the accounts of farmers.
- Prepared data to distribute the amount of 28,000 crores under the CG Government's RJKNY scheme among 2,500,000 farmers.
- Prepared various types of reports for the CG Government related to the RGKNY scheme.
- Developed and created ER diagram, views, index, stored procedures and functions.
- Involved in the design of Physical Database schema, data modeling and performance tuning.
- Monitoring of database size and disk space in Production Environment.
- Using Services (S3,RDS, AWS Glue, Redshift, Glue, Lambda, Python, EC2 and SQL)
- Version Controlling Tool : Git
Ootaboo Pvt. Ltd., Raipur as Full Stack Developer,
May 2015 – March 2019
Duties:
- Developed web based scheduling platform, also prepared data reports based on the criteria
Orbit Plus, Raipur as Full Stack Developer,
May 2014 – April 2015
Duties:
- Website Development, Teaching and Training
Pt. Ravishankar Shukla University, Raipur as Assistant Professor,
Sept 2013 - April 2014
Duties:
- Teaching and Programming training
Other Skills
- Programming Languages : Python [6 Years]
- Database : MySQL [9 Years], MariaDB [9 Years], PostgreSQL, MongoDB
- Data Engineer : NoSQL, SQL, ETL, PySpark [5 Years], Databricks, Redshift, Glue, Delta Lake
- Machine Learning : TensorFlow, Keras, scikit-learn, OpenCV, PyTorch, NumPy, pandas
- Visualization : Matplotlib, Seaborn, Bokeh
- AWS : S3, RDS, AWS Glue, Redshift, Glue, Lambda, EC2
- Azure : Azure Data Factory, Azure Data Lake Storage, Azure Synapse
- Other : Data Modeling, ETL/ELT Design, Data Governance, CI/CD
Journal Publications
1. R.D. Nirala, Shiva Manhar “Visual Improvement for Dense foggy & hazy weather images,Usig Contrast enhancement techniques” ISST Jouranal of Electrical & Electronics Engineering Vol. 7 No1 jan – june 2016 pp 53-62. ISSN 0976-7363.
2. Dr. R.D. Nirala, Shiva Manhar -“A multimodal Enhancement Techniques Using For Visual Improvement Of Dense Foggy & Hazy Weather Image”, Journal of Survey in Fisheries Sciences 8 (3), 654-667