Gopi A.

I am a highly skilled and experienced data engineer and data science enthusiast with over 6 years of experience in building big data applications in the cloud, working in fast-paced startup environments, and developing ETL/ELT pipelines. I am well-versed in big data tools like Hadoop, Spark, Hive, and databases, and have hands-on experience with AWS and Microsoft Azure platforms. I am also experienced in working with DevOps tools and following Agile practices. I am a quick learner and an excellent team player. In my most recent role as a Senior Data Engineer at Nanoprecise Sci Corp, I was responsible for leading data engineering solutions, creating and managing micro-service-based applications for processing data from IOT devices in the AWS cloud, and managing the entire backend software pipeline which includes python apps, Kafka cluster, MongoDB, and web-apps. Prior to that, I worked as a Data Engineer at Honeywell where I developed ETL pipelines using PySpark in Azure Databricks, Java, Python for profound cleansing of datasets from various sources. I hold a Bachelor's degree in Computer Science from IIT Hyderabad and have published a research journal titled “Toward maximizing the visibility of content in social media brand pages: a temporal analysis” in Springer-Verlag GmbH Austria, part of Springer Nature 2018. My skill set includes AWS, Hortonworks, HDInsight Hadoop, Spark, Hive, Apache Kafka, Micro-services Java, Python, Scala, R MSSQL, MySQL, MongoDB Shell scripting, GIT, Docker Jenkins, Bitbucket, Bamboo, Flask, RShiny, and Kubernetes.