Knoxville Metropolitan Area
- Engineered and delivered foundational data assets in interview domain to support scalable reporting infrastructure and analytical workflows.
- Designed and implemented a centralized data repository to systematically organize and store sensor data, manuals, documentation, and research datasets. This initiative significantly enhanced data storage, accessibility, and retrieval protocols at the Manufacturing Demonstration Facility (MDF). - Conducted a comprehensive proof of concept comparing graph databases (Neo4j) and relational databases (Postgres) to assess system requirements, performance, and scalability. The findings informed the selection of an appropriate data warehousing technology stack. - Architected and developed a relational database system from the ground up to store sensor metadata from additive manufacturing (AM) machines. This marked the first structured database implementation at MDF, contributing to more efficient and reliable data management practices. - Developed a web-based metadata management application to streamline the creation, collection, and management of sensor metadata. Built using a modern microservices architecture with Vue.js, the application supports data collection, exploration, and visualization, and is designed for scalability and ease of integration. - Designed and deployed multiple RESTful API services to enable seamless integration across the digital platform ecosystem, connecting tools such as the metadata management application, centralized database, and various research software applications. - Administer user access and data permissions within the centralized repository to ensure compliance with established data governance policies and access control protocols.
- Worked for US Department of Energy funded Atmospheric Radiation Measurement (ARM) program - Managed the operations team at the user facility to manage the data flow, ingest and archival process. The responsibility included identifying bottle necks in the data flow, fix broken processes and improve the overall data archival and metadata management process. - Automated parts of the reprocessing workflow for automatic reprocessing and notifications for reprocessed data. This resulted in significant time improvement to complete a data reprocessing task. - Designed and developed a web application to select multiple primary measurements from a data-set and created web based visualizations in D3.js for atmospheric scientists to help them identify data of potential interest.
- Worked as a Data engineer for US Department of Energy funded Atmospheric Radiation Measurement (ARM) program - Contributed in designing and developing a big historical order data warehouse for historical orders from past 20 years. This data warehouse enabled multiple application development, improved reporting management system and helped ARM create a recommendation system. - Created automated processes for dissemination of metadata to various open data projects and data portals in desired formats(ISO 19115, FGDC). This helped improve ARM data visibility to users across the world. - Migrated all the historical processes from SAS to python. This migration improved the user facility’s reporting process and and turnaround time for requests. Also it helped migrate from paid SAS license to open source free software. - Designed and developed a web application to automate the metrics and reporting process. The application was written is Django and helped the management at DOE and program manager level make decisions about sensors and their usage and deployment. This metrics web application also included web based dynamically generated data visualizations to present current impact and growth.