Loading…

Advertisement:



Big Data Engineer Job In Atlanta, Georgia, Universal Business Solutions

Published 2022-08-08
Expires 2022-09-08
ID #1119181484
Free
Big Data Engineer Job In Atlanta, Georgia, Universal Business Solutions
United States, Georgia, Atlanta,
Published August 8, 2022

Job details:

Job type: Full time
Contract type: Permanent
Salary type: Per annum
Occupation: Big data engineer


⇐ Previous job

Next job ⇒     

Description

Big Data Engineer



Atlanta, GA (Midtown Area)



Hybrid (2 days on site )



Contract ( 2 Years Plus )



Required:



6+ years of overall IT experience



3+ years of experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming



o Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka



o Deep knowledge of troubleshooting and tuning Spark applications



3+ years of experience with data ingestion from Message Queues (Tibco, IBM, etc.) and different file formats across different platforms like JSON, XML, CSV



3+ years of experience with Big Data tools/technologies like Hadoop, Spark, Spark SQL, Kafka, Sqoop, Hive, S3, HDFS, or Cloud platforms e.g. AWS, GCP, etc.



3+ years of experience building, testing, and optimizing 'Big Data' data ingestion pipelines, architectures, and data sets



2+ years of experience with Kudu and Impala



2+ years of experience with Scala (and/or Python) and PySpark/Scala-Spark



2+ years of experience with NoSQL databases, including HBASE and/or Cassandra



Knowledge of Unix/Linux platform and shell scripting is a must



Strong analytical and problem-solving skills



Preferred (Not Required):



Experience with Cloudera/Hortonworks HDP and HDF platforms



Experience with NIFI, Schema Registry, NIFI Registry



Strong SQL skills with ability to write intermediate complexity queries



Strong understanding of Relational & Dimensional modeling



Experience with GIT code versioning software



Experience with REST API and Web Services



Good business analyst and requirements gathering/writing skills



Education



Bachelor's Degree required. Preferably in Information Systems, Computer Science, Computer Information Systems or related field



⇐ Previous job

Next job ⇒     

 

Contact employer

    Employer's info

    Universal Business Solutions
    Registered on October 7, 2017

    Advertisement:

    Quick search:

    Location

    Type city or region

    Category


    Category info:

    Technology ("science of craft", from Greek τέχνη, techne, "art, skill, cunning of hand"; and -λογία, -logia) is the collection of techniques, skills, methods, and processes used in the production of goods or services or in the accomplishment of objectives, such as scientific investigation. Technology can be the knowledge of techniques, processes, and the like, or it can be embedded in machines to allow for operation without detailed knowledge of their workings. The simplest form of technology is the development and use of basic tools. The prehistoric discovery of how to control fire and the later Neolithic Revolution increased the available sources of food, and the invention of the wheel helped humans to travel in and control their environment. Developments in historic times, including the printing press, the telephone, and the Internet, have lessened physical barriers to communication and allowed humans to interact freely on a global scale. The steady progress of military technology has brought weapons of ever-increasing destructive power, from clubs to nuclear weapons.


    Atlanta () is the capital and most populous city of the U.S. state of Georgia. With an estimated 2019 population of 506,811, it is also the 37th most populous city in the United States. The city serves as the cultural and economic center of the Atlanta metropolitan area, home to more than 6 million people and the ninth-largest metropolitan area in the nation. Atlanta is the seat of Fulton County, the most populous county in Georgia. Portions of the city extend eastward into neighboring DeKalb County. The city is situated among the foothills of the Appalachian Mountains and has one of the highest elevations among major cities east of the Mississippi River.Atlanta was originally founded as the terminus of a major state-sponsored railroad. With rapid expansion, however, it soon became the convergence point among multiple railroads, spurring its rapid growth. The city's name derives from that of the Western and Atlantic Railroad's local depot, signifying the town's growing reputation as a transportation hub. During the American Civil War, the city was almost entirely burned to the ground in General William T. Sherman's famous March to the Sea. However, the city rose from its ashes and quickly became a national center of commerce and the unofficial capital of the "New South". During the 1950s and 1960s, Atlanta became a major organizing center of the civil rights movement, with Dr. Martin Luther King Jr., Ralph David Abernathy, and many other locals playing major roles in the movement's leadership. During the modern era, Atlanta has attained international prominence as a major air transportation hub, with Hartsfield–Jackson Atlanta International Airport being the world's busiest airport by passenger traffic since 1998.It ranks in the top twenty among world cities and 10th in the nation with a gross domestic product (GDP) of $385 billion. Atlanta's economy is considered diverse, with dominant sectors that include aerospace, transportation, logistics, professional and business services, media operations, medical services, and information technology. Atlanta has topographic features that include rolling hills and dense tree coverage, earning it the nickname of "the city in a forest". Revitalization of Atlanta's neighborhoods, initially spurred by the 1996 Summer Olympics, has intensified in the 21st century, altering the city's demographics, politics, aesthetics, and culture.

    Source: https://en.wikipedia.org/