11+ Data warehouse architecture Jobs in Bangalore (Bengaluru) | Data warehouse architecture Job openings in Bangalore (Bengaluru)

Our product is centered around lots of data being processed, ingested and read efficiently. The underlying systems need to provide capabilities update and ingest data on the order of billions of records on a daily basis. Complex analytics queries need to run on 10s of billions of rows where a single query that can potentially touch 100+ million rows needs to finish in interactive SLAs. All of this processing happens on data with several 100s of dimensions and tens of thousands of metrics.

This leads to a very interesting and challenging use case in the emerging field of large scale distributed HTAP, which is still not mature enough to provide a solution out of the box that works for our scale and SLAs. So, we are building a solution that can handle the complexity of our use case and scale to several trillions of rows. As a "Database Engineer", you will evolve, architect, build and scale the core data warehouse that sits at the heart of Clarisights enabling large scale distributed, interactive analytics on near realtime data.

What you'll do

- Understanding and gaining expertise in existing data warehouse.
- Use the above knowledge to identify gaps in the current system and formulate strategies around what can be done to fill them
- Avail KPIs around the data warehouse.
- Find solutions to evolve and scale the data warehouse. This will involve a lot of technical research, benchmarking and testing of existing and candidate replacement systems.
- Bulid from scratch all or parts of the data warehouse to improve the KPIs.
- Ensure the SLAs and SLOs of data warehouse, which will require assuming ownership and being oncall for the same.
- Gain deep understanding into Linux and understand concepts that drive performance characteristics like IO scheduling, paging, processing scheduling, CPU instruction pipelining etc.
- Adopt/build tooling and tune the systems to extract maximum performance out of the underlying hardware.
- Build wrappers/microservices for improving visibility, control, adoption and ease of use for the data warehouse.
- Build tooling and automation for monitoring, debugging and deployment of the warehouse.
- Contribute to open source database technologies that are used at or are potential candidates for use.

What you bring

We are looking for engineers with a strong passion for solving challenging engineering problems and a burning desire to learn and grow in a fast growing startup. This is not an easy gig, it will require strong technical chops and an insatiable curiosity to make things better. We need passionate and mature engineers who can do wonders with some mentoring and don't need to be managed.

- Distributed systems: You have a good understanding of general patterns of scaling and fault-tolerance in large scale distributed systems.
- Databases: You have a good understanding of database concepts like query optimization, indexing, transactions, sharding, replication etc.
- Data pipelines: You have a working knowledge of distributed data processing systems.
- Engineer at heart: You thrive on writing great code and have a strong appreciation for modular, testable and maintainable code, and make sure to document it. You have the ability to take new initiatives and questioning status quo.
- Passion & Drive to learn and excel: You believe in our vision. You drive the product for the better, always looking to improve things, and soon become the go-to person to talk to on something that you mastered along. You love dabbling in your own side-projects and learning new skills that are not necessarily part of your normal day job.
- Inquisitiveness: You are curious to know how different modules on our platform work. You are not afraid to venture into unknown territories of code. You ask questions.
- Ownership: You are your own manager. You have the ability to implement engineering tasks on your own without a need for micro-management and take responsibility for any task that has been assigned to you.
- Teamwork: You should be helpful and work well with teams. You’re probably someone who enjoys sharing knowledge with team-mates, asking for help when they need it.
- Open Source Contribution: Bonus.

In this role, you will be responsible to drive innovation in product development, while
relentlessly improving performance, scalability, and maintainability.
● Sound knowledge and application of algorithms and data structures.
● Proficient in Java, Springboot and Mysql.
● Able to efficiently diagnose bugs and issues.
● Understanding of when to escalate questions/issues that arise during development.
● Work with other developers, QA, DevOps and business staff to efficiently launch features
and resolve issues.
● Actively participate in design and code reviews to build robust applications and prototypes.
● A willingness to dive deep, experiment rapidly and get things done.
● Provide input to how we can continually improve our development process and knowledge.
● Define and participate in establishing better engineering practices.
● Love being challenged by learning and experimenting with new technologies
● Experience with ElasticSearch, Cassandra, Redis, Kakfa, AWS is a plus.
● Prior experience in building microservices, have worked on architectures and designs
independently is a plus.
● Prior product building experience or from a startup background would be a plus.

B.Tech./ BE - Computer, IT, Electronics only

Requirements:

• 3+ year of experience in Development in JAVA technology.
• Strong Java Basics
• SpringBoot or Spring MVC
• Hands on experience on Relational Databases (SQL query or Hibernate) + Mongo (JSON parsing)
• Proficient in REST API development
• Messaging Queue (RabitMQ or Kafka)
• Microservices
• Any Caching Mechanism
• Good at problem solving

Skills:

• 3+ years of experience in using Java/J2EE tech stacks
• Good understanding of data structures and algorithms.
• Excellent analytical and problem solving skills.
• Ability to work in a fast paced internet start-up environment.
• Experience in technical mentorship/coaching is highly desirable.
• Understanding of AI/ML algorithms is a plus.
• Java
  Agile and Kafka
  Microservices
  Springboot
  NoSQL/MongoDB
  Scrum

Skills: • Knowledge of Node.js and frameworks such as Express, StrongLoop, etc • Understanding the nature of asynchronous programming and its quirks and workarounds • Good understanding of server-side templating languages like Jade, EJS, etc • Experience with micro-services or highly scalable infrastructure • Experience working with Docker, Redis, MySQL, MongoDB Responsibilities: • Integration of user-facing elements developed by front-end developers with server-side logic • Building reusable code and libraries for future use • Optimization of the application for maximum speed and scalability • Implementation of security and data protection • Design and implementation of data storage solutions • Test coverage for the written code • Troubleshoot and debug applications

 

• Good experience in Javabackend/J2EE, Eclipse, Javascript, XML, Data Structures, Database 
• Should have good experience working in Springboot.
• Good experience in JSON / RESTful API / Web Services.
• Experience with Design Patterns.
• Experience in AWS and Queuing systems is an advantage
• Basic estimation experience
• Self starter and quick learner
• Should be able to work in a growing environment that is very dynamic and challenging
• Good oral and written communication skills
• Highly self motivated and directed
• Ability to work without a lot of supervision
• Experience in working in a team-oriented and collaborative environment.

Primary Responsibilities
 Providing technical expertise for every phase of the project lifecycle—from concept
development to solution design, implementation, optimization and support. Interacts
with a set of clients (client senior developers and architects) to create technology
specifications from business requirements for one of the modules within the project.
 Prepares the technical design of the more complex technology components within the
module (one or more of client/web presentation tier, server tier, data access and data
model, integration component, package function customization).
 Assists the architect in articulating the pros and cons of using a certain technology stack
or component or design pattern versus another to the clients and project team and
drives selection of technologies, designs to come up with the optimal architecture.
Drives the performance tuning, re-design and re-factoring for a module.
 Contributes to designing and implementing the build, releases process as well as system
configuration and deployment characteristics of the application.
Required Tech Stack
 2+ years of strong development skills in Java with JDK 1. 8 & above version &
Microservices with Spring boot/ Spring.
 Should have strong acumen in Data Structures, Algorithms, problem-solving and Logical/
Analytical skills.
 Thorough understanding of OOPS concepts, Design principles and implementation of
different type of Design patterns.
 Sound understanding of concepts like Exceptional handling, Serialization/Deserialization
and Immutability concepts, etc.
 Good fundamental knowledge in Enums, Collections, Annotations, Generics, Auto
boxing, etc. Experience with Multithreading, Concurrent Package and Concurrent APIs Basic
understanding of Java Memory Management (JMM) including garbage collections
concepts.
 Experience in RDBMS or NO SQL databases and writing SQL queries (Joins, group by,
aggregate functions, etc.)
 Experience with at-least one NoSQL (Any of Cassandra/Couch base/Hadoop), Hands-on
experience with JMS
 Hands-on experience in creating RESTful webservices and consuming webservices
 Hands-on experience with Spring.
 Hands-on experience with any of the logging frameworks (SLF4J/LogBack/Log4j)
 Experience of writing Junit test cases using Mockito / Powermock frameworks.
 Should have practical experience with Maven/Gradle and knowledge of version control
systems like Git/SVN etc.
 Good communication skills and ability to work with global teams to define and deliver
on projects.
 Sound understanding/experience in software development process, test-driven
development

As a Software Development Engineer 2, you have industry-leading technical abilities and demonstrate breadth and depth of knowledge. You build software to deliver business impact, making smart technology choices. You work in a team and drive things forward.

Top Skills:
 You write high-quality, maintainable, and robust code, often in Java/C#/Python/C++/Go/Ruby on Rails.
 You recognize and adopt best practices in software engineering: design, testing, version control, documentation, build, deployment, and operations.
 You have experience building scalable software systems that are high-performance, highly-available, highly transactional, low latency and massively distributed.

Roles & Responsibilities:
 You solve problems at their root, stepping back to understand the broader context.
 You develop pragmatic solutions and build flexible systems that balance engineering complexity and timely delivery, creating business impact.
 You understand a broad range of data structures and algorithms and apply them to deliver high-performing applications.
 You recognize and use design patterns to solve business problems.
 You understand how operating systems work, perform and scale.
 You continually align your work with Amazon’s business objectives and seek to deliver business value.
 You collaborate to ensure that decisions are based on the merit of the proposal, not the proposer.
 You proactively support knowledge-sharing and build good working relationships within the team and with others in Amazon.
 You communicate clearly with your team and with other groups and listen effectively.

Skills & Experience:
 Bachelors or Masters in Computer Science or relevant technical field with 3+ years of experience in Design and Development
 Experience in software development and full product life-cycle.
 Excellent programming skills in any object-oriented programming languages - preferably Java, C/C++/C#, Perl, Python, or Ruby.
 Strong knowledge of data structures, algorithms, and designing for performance, scalability, and availability.
 Proficiency in SQL and data modeling.


Location: Hyderabad/Bangalore
CTC - no bar

· 3+ years java development experience with JSE/JEE, Java based Micro-services framework and implementation, Spring framework, Hibernate framework, SQL etc

· Hands on experience on Spring boot & Microservices .

· Strong knowledge of micro-service logging, monitoring, debugging and testing

· Implementations experience of micro-service integration, packaging, build automation and deployment.

· Object Oriented analysis and design using common design patterns.

Must have strong Java Development
Must have hands on with Spring Boot, Microserives
Must have Angular / React experience
immediate to 30 days offical notice will be considered

Java 8 Spring Boot Microservices Exposure in Docker and Kubernetes Exp in Jboss and Tomcat application Server Exp with noSQL databases (e.g. MySql, MongoDB)

Requirements: Strong coding skills in modern languages such as C++/Javascript/Python Strong problem solving skills, algorithmic thinking and a strong foundation in how systems work. Very strong computer science fundamentals Bachelor/Masters in Computer Science, PhD preferred Experience in designing and developing scale-out, high-performance systems OR experience with database design OR experience in building search engines including areas such as search relevance, aggregation and indexing OR full stack/frontend development experience in building complex web/mobile applications is a plus. About ThoughtSpot ThoughtSpot’s AI-Driven analytics platform puts the power of a thousand analysts in every business person's hands. With ThoughtSpot, you can use search to easily analyze your data or automatically get trusted insights pushed to you with a single click. ThoughtSpot connects with any on-premise, cloud, big data, or desktop data source and deploys 85 percent faster than legacy technologies. BI & Analytics teams have used ThoughtSpot to cut reporting backlogs by more than 90 percent and make more than 3 million decisions - and counting. ThoughtSpot’s customers include Amway, Bed Bath and Beyond, Capital One, Celebrity Cruises, Chevron Federal Credit Union, De Beers, Insurethebox and Scotiabank. ThoughtSpot was co-founded in 2012 by its CEO Ajeet Singh and six other technical co-founders from Google, Microsoft, Amazon, and Oracle. The company is based in Palo Alto, CA and is currently expanding operations in North America, Europe and Asia-Pacific. Backed by investors Lightspeed Venture Partners, Khosla Ventures, General Catalyst Partners, Geodesic Capital and Capital One Growth Ventures, ThoughtSpot has raised over $160 million to date. ThoughtSpot’s mission is to enable analytics at "human scale" and put search and AI-driven analytics in the hands of 20 million users by 2020.