Data Architect I

Company: UST
Location: Bentonville
Posted on: November 18, 2021

Job Description:

Big Data Admin -- Description: UST-- is looking for a highly energetic and collaborative Big Data Administrator with experience building enterprise data intelligence on Cloud platforms. The Big Data Admin will be responsible to develop, optimize and oversee the organization---s conceptual and logical data systems, delivering quality reports, data intelligence solutions to the organization and assist client teams with drawing insights to make informed, data driven decisions for a leading Retailer in the United States. The ideal candidate is expected to be experienced in all phases of the data management lifecycle, gather and analyze requirements, collect, process, store and secure, use, share and communicate, archive, reuse and repurpose data. Identify and manage existing and emerging risks that stem from business activities and ensure these risks are effectively identified and escalated to be measured, monitored and controlled. The candidate should be a proven self-starter with demonstrated ability to make decisions and accept responsibility and risk. Excellent written and verbal communication skills with the ability to collaborate effectively with domain experts and IT leadership team is key to be successful in this role. -- Responsibilities: -- As a Big Data Administrator, you will be -- -- -----Responsible for implementation and ongoing administration of Hadoop infrastructure.

• Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
• Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users.
• Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Cloudera Manager Enterprise, Dell Open Manage and other tools.
• Performance tuning of Hadoop clusters and Hadoop MapReduce routines.
• Screen Hadoop cluster job performances and capacity planning
• Monitor Hadoop cluster connectivity and security
• Manage and review Hadoop log files.
• File system management and monitoring.
• HDFS support and maintenance.
• Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.
• Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
• Point of Contact for Vendor escalation
• Data modelling, design & implementation based on recognized standards.
• Software installation and configuration.
• Database backup and recovery.
• Database connectivity and security.
• Performance monitoring and tuning.
• Disk space management.
• Software patches and upgrades.
• Automate manual tasks
• --
• --- Build and maintain active relationships with customers to determine business requirements.
• --- Partner with other IT teams during integration activities to facilitate successful implementations.
• --- Participate in on-call application support and respond to application issues when identified.
• --- Communicate effectively with technical peers in in a clear manner, while also being able to articulate complex solutions in ways nontechnical business partners can understand.
• --- Have a good understanding of where their project fits into the larger goals for engineering and adapts their work so that the priorities of the systems they are creating match those of the organization
• --
• Requirements:
• --- BA/BS degree or technical institute training or equivalent work experience
• --- 4+ years of hands on experience in Hadoop Admin , Hive ,Spark, Kafka is must
• --- Minimum 3 years of work experience in maintaining, optimization, issue resolution of Big Data large scale clusters, supporting Business users and Batch process.
• Hands-on Experience No SQL Databases HBASE is plus
• Prior Experience in Linux / Unix OS Services, Administration, Shell, awk scripting is a plus
• Excellent oral and written communication and presentation skills, analytical and problem solving skills
• Self-driven, Ability to work independently and as part of a team with proven track record
• Experience on Hortonworks distribution or Open Source preferred -- --- Experience with one or more software version control systems (e.g. Git, Subversion) --- Experience overseeing team members. --- Excellent communication and presentation skills. --- Experience in agile environment --- Experience with Sprint Boot, Maven, Bamboo and great debugging skills. --- Great understanding with builds, software development and GIT. --- Strong effective communication skills, both written and verbal -- --The most successful candidates will also have experience in the following: --- Gitflow --- Atlassian products --- BitBucket, JIRA, Confluence etc. --- Continuous Integration tools such as Bamboo, Jenkins, or TFS -- Location: This position will be based in Bentonville, AR Role Proficiency: Design develop and implement data architecture for a large enterprise in two of the following: Data ingestion Data Management Data Delivery Data Consumption. Outcomes:
• -- Architect design and implement high performance large volume data integration transformation warehouse data lakes data in cloud or large volume warehouse data in cloud data analysis reporting and visualization of data from data warehouse using any one tool like(PowerBI Tableau D3 etc)
• -- Design and implement any one of cloud big data solution (AWS/AZURE/GCP/Apache Hadoop)
• -- Plan information architecture by studying the site concept strategy domain and target audience; information structure and features designing information structure evaluating information representation backup recovery and security specification
• -- Customer focus --- improves customer service effectively engages customers build with customer on your solution capability.
• -- Provide end-to-end technical guidance and roadmaps for Sales & Marketing
• -- Validate estimates from team
• -- Hold certification in Architect/Big Data specialty certification in one of AWS or Azure or GCP with experience in knowledge of other architecting Big Data solutions on other cloud and Big Data platforms -- Measures of Outcomes:
• -- Percent of time spent in a year to develop for customer an architecture or strategy for data
• -- Percent of time spent in solving customer problem in data area
• -- Percent of time spent for provide data strategy for customer
• -- Dollar value of RFP---s won for which solutioning was proposed
• Dollar value saved for customer using cost reduction or dollar value created for customer by prediction models by you or your team -- Outputs Expected: Strategy & Planning:
• Develop and deliver long-term strategic goals for data architecture vision and standards in conjunction with data users department managers clients and other key stakeholders
• Create short-term tactical solutions to achieve long-term objectives and an overall data management roadmap
• Establish processes for governing the identification collection and use of corporate data assets and metadata; take steps to assure metadata accuracy and validity
• Establish methods and procedures for tracking data quality completeness redundancy and Improvement
• Ensure that data strategies and architectures meet regulatory compliance requirements
• Engage external stakeholders including standards organizations regulatory bodies operators and scientific research communities
• Ensure business needs in operational data reporting data are met Operational Management :
• Establish governance stewardship and frameworks for managing data across the organization
• Develop and promote data management methodologies and standards
• Select and implement the appropriate tools software applications and systems to support data technology goals
• Collaborate with project managers and business teams for all projects involving enterprise data
• Address data-related issues with systems integration compatibility and multi-platform integration
• Act as a leader and advocate of data management including coaching training and Develop and implement key components as needed to create testing criteria in order to guarantee the fidelity and performance of data architecture
• Document the data architecture and environment in order to maintain a current and accurate view of the larger data picture
• Identify and develop opportunities for data reuse migration or retirement Project Control and Review :
• Perform data architecture design review
• Identify opportunities for optimization of cost time and asset utilization in complex projects and advise relevant teams accordingly where possible
• Provide advice to teams facing complex technical issues in the course of project delivery
• Conduct planned and unplanned technical audits for complex projects as applicable
• Define and measure project and program specific architectural and technology quality metrics Knowledge Management & Capability Development :
• Provide inputs to teams for training etc.
• Identify the training needs and conduct internal sessions to meet the same
• Partner with UST Gamma to Create curriculum assessments training programs courseware based on new service offerings and solutions etc.
• Update collateral on to the knowledge management repository
• Gain and cultivate domain expertise to provide best and optimized solution to customer Requirement gathering and Analysis:
• Understand the requirements from a larger system / transformation program context
• Validate the cross application / cross technology requirements to ensure integrate ability and reconciliation of conflicting requirements by working with customers and other stakeholders People Management:
• Provide support to various project managers in identification of training needs of the team
• Conduct training / certifications with the help of Gamma and mentoring with respect to technical skills on projects
• Support technical evaluation of external and internal candidates to meet project requirements
• Perform career guidance and performance management for team members Alliance Management:
• Identify alliance partners based on the understanding of service offerings and client requirements.
• Identify areas for joint GTM with the partner
• Develop internal capabilities/complementary toolsets to support the GTM strategy
• Maintain the relationship with partners
• Act as the UST technical POC for the specific technology/solution area Technology Consulting:
• Define problem statement for the customer
• Analyse application/ technology landscape process tools and arrive at the solution options best fit for the client
• Analyse Cost Vs. Benefits of solution options
• Define the technology/ architecture roadmap for the client
• Articulate the cost vs. benefits of options to key stakeholders in customer Innovation and Thought Leadership:
• Participate in external forums (seminars paper presentation etc.)
• Interact and engage with customers/ partners around new innovative ideas concepts assets; as well as industry trends and implications
• Participate in Beta testing of products / joint lab setup with customer to explore application of new technologies / products
• Identify areas where components/accelerators or design patterns could be reused across different accounts
• Create documents reports white papers (international/national) on the research findings Sales Support and Project Estimation:
• Develop collaterals for proposals
• Compare various designs and propose appropriate technology solutions based on the understanding of the RFP and inputs from Architects
• Calculate and present estimates based on high level designs to management for supporting go/ no-go decisions
• Review estimations and resource plan
• Review risk and mitigation plan
• Participate in client presentation and client visits Data Design & Definition:
• Ensure alignment of the high-level architecture with the existing client need and business logic / review design prepared by architects
• Ensure the involvement of appropriate teams in data design
• Ensure technical integrate ability requirements compliance of the solution especially in case of a multi group / multi-vendor program
• Involve external partners / horizontals as appropriate
• Provide guidance to the team around the usage of data architecture and experience in solution implementation product selection and definition configuration migration and transformations between cloud and hosted solutions. Take responsibility for developing cutting edge wallet applications
• Ensure UST architecture principles and QOA (Quality of Architecture) are maintained. Analyse trade-offs and provide recommendations if any on the data architecture
• Identify opportunities for efficiency improvements.
• Understand the various work streams and the technologies necessary to deliver on large programs
• Resolve any issues based on industry expertise / partners leverage
• Provide best in class technology and solution options to customers with detailed examples and case studies. Guide customer on process and technology improvements to achieve agility and quick results Project Management Support:
• Proactive identification and management of technical risks Stakeholder Management:
• Build credibility with the client as a technical go-to person
• Work to expand professional network in the client organization New Service Design:
• Identify potential opportunities for new service offerings based on customer voice/ partner inputs / industry connects and trends
• Support the development of business case for investments for approval from management
• Work with partners to co-develop a joint GTM (as applicable)
• Develop IP/tools and framework to address the opportunity technically
• Lead beta testing / POC as applicable
• Develop collaterals guides for GTM -- Skill Examples:
• -- Use knowledge of technology trends to provide inputs on potential areas of opportunity for UST
• -- Use knowledge of Architecture Concepts and Principles to create architecture catering to functional and non-functional requirements under guidance of the specialist. Re-engineer existing architecture solutions under the guidance of the specialist. Provide training on best practices in architecture under guidance
• -- Use independent knowledge of Design Patterns Tools and Principles to create high level design for the given requirements. Evaluate multiple design options and choose the appropriate options for best possible trade-offs. Conduct knowledge sessions to enhance team's design capabilities. Review the low and high level design created by Specialists for efficiency (consumption of hardware memory and memory leaks etc.) and maintainability of design
• -- Use knowledge of Software Development Process Tools & Techniques to identify and assess incremental improvements for software development process methodology and tools. Take technical responsibility for all stages in the software development process. Conduct optimal coding with clear understanding of memory leakage and related impact. Implement global standards and guidelines relevant to programming and development come up with 'points of view' and new technological ideas
• -- Use knowledge of Project Management & Agile Tools and Techniques to support plan and manage medium size projects/programs as defined within UST; identify risks and mitigation strategies
• -- Use knowledge of Project Metrics to understand relevance in project. Collect and collate project metrics and share it with the relevant stakeholders
• -- Use knowledge of Estimation and Resource Planning to create estimate and plan resources for specific modules / small projects with detailed requirements or user stories in place
• -- Use knowledge of Knowledge Management Tools & Techniques to leverage existing material/ re-usable assets in knowledge repository. Independently create and update knowledge artefacts. Create and track project specific KT plans. Provide training to others write white papers/ blogs at internal level write technical documents/ user understanding documents at the end of the project
• -- Use knowledge of Technical Standards Documentation & Templates to create documentation appropriate for the project needs. Create documentation appropriate for the reusable assets/ best practices/ case studies
• -- Use knowledge of Requirement Gathering and Analysis to support creation of requirements documents or user stories and high level process maps. Identify gaps on the basis of business process analyse responses to clarification questions and produce design documents. Create and review estimates and solutions at project level/program level. Create and review design artefacts update resourcing and schedule based on impacted areas identified. Create design specifically for the non-functional requirements
• -- Strong proficiencies in understanding data workflows and dataflows
• -- Attention to details
• -- High Analytical capabilities
• -- Creativity in developing solutions
• -- Self-learning
• -- Resilience in solving problems -- Knowledge Examples:
  • -- Domain knowledge understanding domain data
  • -- Applied Mathematics and Statistics
  • -- Skilled in writing design documents usage of Power Point Visio
  • -- Data visualization streaming
  • -- Data migration
  • -- Data modelling vector and Graphs
  • -- RDMSs (relational database management systems) SQL
  • -- Databases such as NoSQL and cloud computing
  • -- Hadoop technologies like MapReduce Hive and Pig
  • -- Programming languages especially Python and Java
  • -- Operating systems including UNIX and MS Windows
  • -- Cloud solutions
  • -- Backup/archival software
  • -- Understanding of data security
  • Additional Comments: None

Keywords: UST, Springdale , Data Architect I, Other , Bentonville, Arkansas