Welcome!


Latest Blogs from Apache Developer's Journal
Apache Hadoop is emerging as a distributed platform for handling large and fast incoming streams of data. Predictive maintenance, supply chain optimization, and Internet-of-Things analysis are examples where Hadoop provides the scalable storage, processing, and analytics platform to ga...
This post is the first in a series of blog posts that will explore and exploit the Big Data and analytics tools. I will walk through easy steps to start working with such tools like Apache Hadoop, Pig, Mahout and solve some problems related to analytics and learning in the large scale ...
It used to take months to travel across the U.S. Or any sizable landmass for that matter. One of the few really well documented wagon trains took four months to travel from Iowa to Montana… A trip that takes an airplane about four hours today. And that airplane trip is a ton safer too....
It’s no news that microservices are one of the top trends, if not the top trend, in application architectures today. Take large monolithic applications which are brittle and difficult to change and break them into smaller manageable pieces to provide flexibility in deployment models, f...
“DevOps is really about the business. The business is under pressure today, competitively in the marketplace to respond to the expectations of the customer. The business is driving IT and the problem is that IT isn't responding fast enough," explained Mark Levy, Senior Product Marketi...
What are the benefits of using an enterprise-grade orchestration platform? In their session at 15th Cloud Expo, Nate Gordon, Director of Technology at Appcore, and Kedar Poduri, Senior Director of Product Management at Citrix Systems, took a closer look at the architectural design fac...
There are not many times in my career that I am going to be able to quote Will Smith, but in the “Will2K” video, Will states “You Never Know Where You Are Going Until You Know Where You Have Been”. For me, this summarizes why measurements and metrics are so important. Unless you can u...
Hadoop as a Service (as offered by handful of niche vendors now) is a cloud computing solution that makes medium and large-scale data processing accessible, easy, fast and inexpensive. In his session at Big Data Expo, Kumar Ramamurthy, Vice President and Chief Technologist, EIM & Big ...
The integration between the 2 solutions is handled by a module provided by XebiaLabs that will ensure the containers are correctly defined in the XL Deloy repository based on the information managed by Puppet. It uses the REST API offered by the XL Deploy server: so the security permis...
Containers have changed the mind of IT in DevOps. They enable developers to work with dev, test, stage and production environments identically. Containers provide the right abstraction for microservices and many cloud platforms have integrated them into deployment pipelines. DevOps and...
We've covered the benefits and pitfalls of configuration management tools like Chef in many articles. But let's assume you've done your homework and decided Chef is the tool for you. How do you get started? Funnily enough, one of the inspirations for ScriptRock was a not-so-successf...
One of the most frequently requested Rancher features, load balancers are used to distribute traffic between docker containers. Now Rancher users can configure, update and scale up an integrated load balancing service to meet their application needs, using either Rancher's UI or API. ...
For many, and for myself, the basis of modern Lean principles come from Toyota and the Toyota Production System. If you want to read about this in detail then I would recommend The Toyota Way, by Jeffrey Liker, a book that I read a couple a years ago and enjoyed. Often referred to as L...
ProfitBricks, the provider of painless cloud infrastructure IaaS, today released its SDK for Ruby, written against the company's new RESTful API. The new SDK joins ProfitBricks' previously announced support for the popular multi-cloud open-source Fog project. This new Ruby SDK, which e...
New in the CTOvision Research Library: We have just posted an overview of an architectural assessment we produced laying out best practices and design patterns for the use of SAS and Apache Hadoop, with a focus on the government sector. Enterprises in government are awash in more data...
In cloud-based architectures, the situation is different and the network has become even more important. Let’s imagine a typical cloud-based architecture situation. You run a datacenter with a flexible number of allocated computing instances (for example, due to the pricing model and v...
Red Hat made the interesting times in which we live a little more interesting recently by announcing OpenShift Commons, "a place for companies using OpenShift to accelerate its success and adoption. To do this we'll act as resources for each other, share best practices and provide a fo...
The term DevOps is not well defined, and you'd be hard pressed to get the same definition of "DevOps" from everyone you ask in your enterprise. Developers in your organization may equate DevOps with a specific approach to software builds and the use of popular tools such as Chef, Puppe...
JMS provides a standard messaging API for interoperability of applications on the Java platform. This enables your JVM-backed applications to connect to each other to send and receive messages. RabbitMQ is a messaging broker that serves as an intermediary for messaging between multiple...
Using Cloud (aka SaaS) applications is natural for most of us — simply sign up with your email, login and then use the service within minutes. The Cloud works particularly well with consumer-oriented services. Businesses, however, have slightly different needs. Up until now, Semate...
Today, we are proud to announce the first code drop of Apache Ignite, Apache Ignite v1.0 RC (Release Candidate), available for download on the Apache Ignite homepage. This is an exciting time for the project and the committers have been working hard since November to reach this milesto...
Over the next several months, I’m going to share with you an interview series featuring my DevOps friends, letting them talk about what they have planned for 2015. To preview some of the folks I’ll be communicating with, I’ve put together a teaser of who I’ll be talking with in one for...
Log data provides the most granular view into what is happening across your systems, applications, and end users. Logs can show you where the issues are in real-time, and provide a historical trending view over time. Logs give you the whole picture.
VentureBeat and GigaOm are both reporting that Pivotal will be announcing some big shifts in their Hadoop and other related offerings (recall that Pivotal is the firm spun off from EMC and VMware and has GE as a major investor). VentureBeat first announced that Pivotal will be ditch...
The Evident.io Security Platform (ESP) is a cloud­-first security and threat analysis service for AWS. ESP provides security best practice checks that give you visibility into your part of the AWS Shared Security Responsibility model. This visibility can scale from one to thousands of ...
Kafka 0.8.2 has a pile of new metrics for all three main Kafka components: Producers, Brokers, and Consumers. Not only does it have a lot of new metrics, the whole metrics part of Kafka has been redone — we worked closely with Kafka developers for several weeks to bring order and stru...
Dynatrace monitors your entire application delivery chain. All of your transactions are tracked end-to-end, from user clicks to individual lines of code, using Dynatrace PurePath technology. Dynatrace constantly monitors your servers’ host and process health, and will automatically not...
In Agent version 1.61 we introduced support for the communication protocol Thrift. Thrift is a cross-platform cross-language communication framework that behaves very much like web services and so therefore automatically show ups in ruxit monitoring. It’s used by a wide variety p...
The NetBeans New File wizards greatly simplify writing boilerplate code. One specific instance is the creation of JPA Controller Classes from an Entity Classes. The class file, or files, written for you will contain all the basic methods of JPA for CRUD operations on the entity or enti...
Last year, we launched Single Sign-On (SSO) to make it easier and more secure to manage your PagerDuty users. We’re excited to add Google Apps as an SSO partner alongside Okta, OneLogin, Ping Identity, Active Directory, and more. Why Use SSO with PagerDuty? Revoke User Access. Us...
“Solr or Elasticsearch?”…well, at least that is the common question I hear from Sematext’s consulting services clients and prospects. Which one is better, Solr or Elasticsearch? Which one is faster? Which one scales better? Which one can do X, and Y, and Z? Which one is easier to ...
Utilizing data-driven intelligence across the enterprise requires solutions that enable interactive, self-service ways of working with historical and near real-time data. Core Hadoop platform has already solved many of the fundamental (legacy) Big Data access and availability problems....
The example of a huge company might alienate. It's DevOps on a massive scale, with a budget enough to create custom tools and personnel time enough to constantly develop initiatives. But DevOps can take any form you like, you can introduce it to your organization at any time, and it...
This week there has been a great discussion between David Berlind of ProgrammableWeb and Kin Lane of APIEvangelist.com, on the topic of categorizing Public and Private APIs. David quotes my ProgrammableWeb piece on Uber and ESPN, which talks about different API strategies, public and p...
Apache Drill is an open source, schema-free SQL query engine—that enables a business to extract the most value possible from data stored in Hadoop. Apache Drill does this by breaking down many of the technical barriers that had restricted the ways that analysts could work with data, an...
Whenever people discuss DevOps they always speak of a "Wall of Confusion" between development and operations, and while there is certainly a barrier to understanding it's more than just a "wall." I see it more as a "canyon of distrust" or a "gulf of miscommunication." These are all ju...
With Dell’s acquisition of Quest and all the IT reorganization that followed, it is actually not that easy to find these two popular free PowerShell tools any longer. So here are the links that work today (January 30, 2015)
About 10 days ago we ran a a poll about which languages/APIs people use when writing their Apache Kafka Producers and Consumers. See Kafka Poll: Producer & Consumer Client. We collected 130 votes so far. The results were actually somewhat surprising! Let’s share the numbers f...
Tickets are useful as a status tracking mechanism, but when did our industry decide chasing tickets was the best way to manage IT support and operations work? We think it’s time to evolve to an ITSM 2.0 approach that puts the focus on ensuring IT support and operations teams have th...
The goal of any organization should be to have clearly defined release phases, where all parties are aware of the phase activities and key gates/milestones. The absence of purpose built collaboration tools has caused barriers in communication, information sharing and tracking of these ...