Find Jobs
Hire Freelancers

Need a scala spark job to read csv from S3 and load into cassandra

$30-250 USD

Mbyllur
Postuar over 4 years ago

$30-250 USD

Paguhet në dorëzim
scala object main def should have 6 arguments as below. val awsAccessKeyId: String = args(0) val awsSecretAccessKey: String = args(1) val csvFilePath: String = args(2) val host: String = args(3) val username: String = args(4) val password: String = args(5) *based on the args, the job should read csv file from s3 and load into cassandra. *you can use any csv file say 2 fields, and cassandra table has 3 columns.. * need complete project codes, dependency jars, tools used and all versions etc.
ID e Projektit: 20426564

Rreth projektit

17 propozime
Projekt në distancë
Aktive 5 yrs ago

Po kërkoni të fitoni para?

Përfitimet e ofertës për Freelancer

Vendosni buxhetin dhe afatin tuaj
Paguhuni për punën tuaj
Përshkruani propozimin tuaj
Është falas të regjistrohesh dhe të bësh oferta për punë
17 freelancers are bidding on average $185 USD for this job
Avatari i Përdoruesit
Hi i am a Data Scientist working in machine learning from past 3 years. i have done many projects like recommendation system, anomaly detection, fraud detection etc. i can do your task in Python very efficiently.
$140 USD në 7 ditë
5,0 (8 përshtypje)
4,3
4,3
Avatari i Përdoruesit
Hi, I have more than 5+ years of experience in hadoop ecosystems like HDFS, MapReduce, Hive, Spark etc. I can complete your project. Please contact me for more details.
$200 USD në 2 ditë
4,8 (14 përshtypje)
4,6
4,6
Avatari i Përdoruesit
Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like springboot, angular, node, PHP, Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks
$277 USD në 3 ditë
5,0 (8 përshtypje)
4,1
4,1
Avatari i Përdoruesit
Hi, I worked with same set before(Scala,s3 and cassandra) and can easily deliver solution within next day.
$200 USD në 2 ditë
5,0 (3 përshtypje)
2,5
2,5
Avatari i Përdoruesit
Hi, I have over 5 years of experinece in scala java spark strom hdfs. I have written may live streaming and batch mode projects. I can complete this work in 5 days. Thanks Devesh Kumar
$120 USD në 7 ditë
5,0 (1 review)
2,3
2,3
Avatari i Përdoruesit
Hi, I am a bigdata developer and a module lead in reputed MNC.i an into the IT industry for more then 12 years. I have tonnes of experience in developing projects using Java,Apache Spark,Hive,Kafka,Scoop,Pig,Scala,aws,jsp,html,css,jquery and managing cluster on aws cloud. I have my youtube channel to on AWS . I have delivered multiple projects and lectures on setting up apache Spark on AWS EMR... I can be the best suitable person for your requirements I have also created multiple freelance project on AWS EMR,S3,REKOGNITION, RDS, and many more services Let me know your view Regards,
$200 USD në 7 ditë
5,0 (1 review)
1,6
1,6
Avatari i Përdoruesit
Hi, I am interested in this project. I've more than 5 yrs of experience in big data related tools and technologies. I've already implemented the spark scala related pipelines on aws for my company.
$180 USD në 7 ditë
5,0 (1 review)
0,7
0,7
Avatari i Përdoruesit
"Hi, Hope you are doing well! Thanks for sharing your project requirement with us. It will be our great pleasure to work on your project. I have checked your requirement, yes we can do it, because we already work on similar requirement in past. We have right skills to work on this assignment. . We will complete the work as per requirement Also my team working on same project" We have read out every thing about your project kindly confirm"
$140 USD në 7 ditë
0,0 (3 përshtypje)
0,0
0,0
Avatari i Përdoruesit
Hi, I can help you in this project as I have good expertise in Spark jobs to read CSV and export data to NoSQL dbs. Thanks
$250 USD në 7 ditë
0,0 (0 përshtypje)
1,0
1,0
Avatari i Përdoruesit
I have been working for more than 3 years in Hadoop/Big Data stack. It will be my pleasure if you give me an opportunity to work on your project. Please connect me for further details to start working on this.
$175 USD në 7 ditë
0,0 (0 përshtypje)
0,0
0,0
Avatari i Përdoruesit
I have read your project requirements and i understood it clearly. I am Scala Spark developer with 3 year of experience. I have worked on lot of Machine learning and Data Sciences projects. Some of them are listed below. Implementation of island model for BAT algorithm in Scala and Spark Number Plate Recognition Fault Detection in a Network Credit card fraud detection Recommendation engine for courses If you award this project to me, I will provide you higher level of your satisfaction.
$200 USD në 7 ditë
0,0 (0 përshtypje)
0,0
0,0
Avatari i Përdoruesit
I have been doing the data processing using the spark and Scala for last 4 yrs - so this is suiting me very much. Deliverable: Application code and packaged jar along with a tutorial about how to maintain the code in IntelliJ or other IDE of your choice. we can use public git to deliver the artifacts if you wish so Infrastructure: If you provide the Cassandra server and S3 I can make use of that. Else I can demo the code using my own Cassandra server and AWS Free Usage Tier's S3
$60 USD në 4 ditë
0,0 (0 përshtypje)
0,0
0,0
Avatari i Përdoruesit
Hi It is straight forward requirement and would like to take up the project. Please reach out to me for further discussion. Thanks.
$261 USD në 15 ditë
0,0 (1 review)
0,0
0,0
Avatari i Përdoruesit
I have more than 4 years of experience writing spark code with scala and python. I have also been working with AWS projects since 1 year. There are two ways to go about solving this problem: 1. Using spark dataframe's write function to write the data to Cassandra DB. 2. Using RDD to use the saveToCassandra method while passing in the schema.
$120 USD në 4 ditë
0,0 (0 përshtypje)
0,0
0,0

Rreth klientit

Flamuri i UNITED STATES
United States
0,0
0
Anëtar që nga sht 26, 2015

Verifikimi i klientit

Faleminderit! Ne ju kemi dërguar me email një lidhje për të kërkuar kredinë tuaj falas.
Ndodhi një gabim gjatë dërgimit të email-it tuaj. Ju lutemi provoni përsëri.
Përdorues të regjistruar Punë të postuara
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Po ngarkohet shikimi paraprak
Leja u dha për Geolocation.
Seanca e hyrjes ka skaduar dhe ke dalë. Hyr sërish.