SpartanburgRecruiter Since 2001
the smart solution for Spartanburg jobs

Lead Data Engineer

Company: Advance America
Location: Spartanburg
Posted on: October 10, 2019

Job Description:

OverviewThe Lead Data Engineer is responsible for aggregating all data across the enterprise, managing that data, and leveraging it to service internal teams and external clients to provide insights and make better business decisions. This position will develop, support and implement data services for multiple applications to meet business objective and user requirements. Works closely with users, developers, operations and business partners to define data service requirements and data preparation process development - work closely with and learn from other data professionals skilled in BI, data science, machine learning (ML) and data warehousing.Responsibilities




  • Design and build data service infrastructure on multiple data platforms, according to key business processes and the overall workflow
  • Develop and implement data solutions for multiple applications to ensure its scalability, availability and maintainability
  • Implement data migration and transformation activities/processes to ensure the accuracy and security of data solutions
  • Define the overall solution architecture needed to implement a layered data stack that ensures a high level of data quality and timely insights
  • Provide expertise on all data concepts for the broader advanced analytics group, and inspire the adoption of advanced analytics, data engineering and data science across the organization
  • Partner to understand business objectives and apply deep understanding of data to identify data needed to support use cases.
  • Translate complex functional and technical requirements into detailed big data design solutions conformant to enterprise standards, architecture and technologies.
  • Test prototypes and oversee handover to operational teams.
  • Monitor databases to ensure accurate and appropriate use of data and perform quality control of database activities.
  • Troubleshoot and correct problems discovered in production and non-production platforms.
  • Drive platform self-service through the creation maintenance and publishing of support documentation and procedures.
  • Maintain involvement in continuous improvement of Big Data solution processes, tools and templates.
  • Prepare the data needed for the Business Intelligence dashboards and perform POCs on various reporting tools
  • Own the technical solution design, lead the technical architecture and implementation of data acquisition and integration projects
  • Create and maintain designs for securing the data while in motion and at rest
  • Perform data profiling, complex sampling, statistical testing, and testing of reliability on data
  • Design and implement data pipeline improvements - Optimize data delivery
  • Identify incomplete data, improve quality of data, and integrate data from several data sources


    QualificationsEducational Background & Professional Experience: Bachelor's degree or foreign equivalent in Computer Science, Information Systems, or closely related field and 6 years of experience developing data integrations for data ingestion, data mapping, and data processing capabilities.

    Skills, Knowledge, Competencies: Five plus years building, and developing databases, data warehouses, data models and managing complex database environments. Proficient in SQL; experience across multiple coding environments e.g. python, java script. Experience building interfaces for front end data delivery. Expert in data orchestration, workflow management, APIs, across different technology platforms. Knowledge of cloud data warehouse solutions (Amazon Redshift, Snowflake, Microsoft Azure). Strong interest for data science, as well as interactive reporting. Strong commitment to organizational success and teamwork. Demonstrated ability to exchange ideas and convey complex information clearly and concisely. Experience in finance, sales, and/or marketing desirable.

    Physical Requirements: Sitting for long periods of time; standing occasionally; walking; bending; squatting; kneeling; pushing/pulling; reaching; twisting; frequent lifting of less than 10 lbs., occasional lifting of up to 20 lbs.; typing; data entry; grasping; transferring items between hands and/or to another person or receptacle; use of office equipment to include computers; ability to travel to, be physically present at, and complete the physical requirements of the position at any assigned location.

    Travel: Up to 50%

    Attire: Casual (Dress appropriately for the occasion)

    Other: Must be eligible to work in the USA and able to pass a background check.

Keywords: Advance America, Spartanburg , Lead Data Engineer, Engineering , Spartanburg, South Carolina

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Senior / Lead Electrical Engineer
Description: Salary/Rate N/A Permanent Location US-NC-Charlotte, United States Posted By Wood. Date Posted 1 hour ago Expires 15 Nov 2019 Qualifications None Senior / Lead Electrical Engineer in US-NC-Charlotte, United (more...)
Company: Wood
Location: Charlotte
Posted on: 10/21/2019

Principal Data Engineer
Description: Brighthouse Financial is on a mission to help people achieve financial security. As one of the largest providers of annuities and life insurance in the U.S., we specialize in products designed to help (more...)
Company: Brighthouse Financial, Inc.
Location: Charlotte
Posted on: 10/21/2019

Customer Success Engineer
Description: Customer Success/Continuous Improvement Engineer Rochester, NY br Local candidates only NO SPONSORSHIP AVAILABLE AT THIS TIME br br br Our product provides plant level information in a cloud (more...)
Company: Fast Tracking Solutions (FTS)
Location: Charlotte
Posted on: 10/21/2019


Application Support Engineer
Description: Application Support Engineer Location: Charlotte, NCDuration: Contract to Hire Phone/Video Interview onlyImmediate, contract to hire opportunity
Company: The Brixton Group, Inc.
Location: Charlotte
Posted on: 10/21/2019

Production Support Engineer, Lead
Description: Production Support Engineer, Lead . We are unable to sponsor as this is a permanent full time role Responsibilities Utilize proven systems, Scripting and dev skills to execute highly complex tasks
Company: Request Technology - Kyle Honn
Location: Charlotte
Posted on: 10/21/2019

Lead Network Security Engineer
Description: Lead Network Security Engineer Responsibilities Reviews and evaluates business technology needs, security, and systems requirements to decide on best course of action develops specifications and performs (more...)
Company: Request Technology - Kyle Honn
Location: Charlotte
Posted on: 10/21/2019

Telecom Engineer III
Description: Job Description:Duration: 12 Months ul li This position is for a telecom analyst/engineer specializing in data and voice. It will
Company: US Tech Solutions
Location: Charlotte
Posted on: 10/21/2019

Urgent requirement: Data Engineer- Charlotte, NC 28262
Description: Currently Webilent Technology, Inc is looking for talented resources for one of their listed clients. Below are further details on the position: Urgent
Company: Webilent Technologies, Inc.
Location: Charlotte
Posted on: 10/21/2019

Fire Protection Consultant/Engineer
Description: As a Fire Protection Consultant/Engineer at Global Fire Protection Group, you will be the primary contact for customer facing project work. This key position works closely with AHJ'S and clients to ensure (more...)
Company: Global Fire Protection Group, LLC
Location: Charlotte
Posted on: 10/21/2019

CI/CD Engineer
Description: Client is is looking for a talented, proactive and results-oriented software engineer to maintain and enhance a CI/CD build system for our single page web application Ember.js React . In this position, (more...)
Company: DISYS
Location: Charlotte
Posted on: 10/21/2019

Log In or Create An Account

Get the latest South Carolina jobs by following @recnetSC on Twitter!

Spartanburg RSS job feeds