Welcome!

Apache Authors: Gilad Parann-Nissany, ChandraShekar Dattatreya, Michael Meiner, MC Brown, Amy Lindberg

Blog Feed Post

Energy Department Announces New SunShot Projects to Harness the Power of Big Data

By

US-Department-of-Energy-logoEditor’s note: The following announcement from the Department of Energy provides context on a potentially very virtuous use of advanced data analysis capabilities to help solve real-world challenges regarding energy costs in the US. Before you get too excited about the potential here, remember to read the details. As you dig deeper into the list of projects you will note some potential for continued government-contractor goofiness and waste, like giving $600k to SRI to have them develop new software to read scientific publications. Seems like they could just buy some basic discovery tools for that or if they wanted to really use advanced big data tools could start by leveraging the Apache Hadoop framework first. So read the below but remember, the devil is in the details- bg

Energy Department Announces New SunShot Projects to Harness the Power of Big Data

January 30, 2013 -release

As part of the Energy Department’s SunShot Initiative, the Department today announced seven data-driven projects to unearth new opportunities for reducing costs and accelerating solar energy deployment in the United States. These projects—located in California, Colorado, Connecticut, Massachusetts, North Carolina and Texas—will result in viable methods for dramatically transforming the operations of solar researchers, manufacturers, developers, installers, and policymakers, and speed the commercialization and deployment of affordable, clean solar energy.

“Through powerful analytical tools developed by our nation’s top universities and national labs, we can gain unparalleled insight into solar deployment that will help lower the cost of solar power and create new businesses and jobs,” said Energy Secretary Steven Chu. “Projects like these will help accelerate technological and financing innovations—making it easier for American families and businesses to access clean, affordable energy.”

The Energy Department will invest about $9 million across the seven projects announced today. These efforts will help scientists, project developers, installers, and communities work together to discover previously unexplored ways to improve solar cell efficiency, reduce costs, and streamline installation processes.

Harnessing Real-World Data to Solve Industry Challenges

As part of the investment announced today, the Energy Department will provide $7 million to research teams led by Sandia National Laboratories, the National Renewable Energy Laboratory, Yale University and the University of Texas–Austin. These teams will partner with public and private financial institutions, utilities, and state agencies to apply statistical and computational tools to industry problem-solving and lead regional pilot projects across the country to test the impact and scalability of their innovations.

For example, Yale University researchers will partner with SmartPower’s New England Solar Challenge to design and implement innovative strategies that can increase the effectiveness of community-led bulk solar purchase programs. The team from the University of Texas–Austin will work with complex datasets from six Texas utilities to better understand customer needs and identify opportunities to streamline installation and interconnection. Similarly, the National Renewable Energy Laboratory in Golden, Colorado, will lead another project with Clean Power Finance to develop a computational model that will analyze data from over 1,300 solar installation companies to establish new types of community- and regional-scale financing structures.

Charting Market Evolution and Technology Innovation

Additionally, the Energy Department is investing $2 million across three projects led by the University of North Carolina–Charlotte, Massachusetts Institute of Technology, and SRI International to analyze decades’ of scientific publications, patents and cost and production data. Through these projects, researchers will be able to obtain a complete picture on the U.S. solar industry, discover methods to accelerate technological breakthroughs, and remove roadblocks to greater cost reduction.

Based in Menlo Park, California, SRI International will develop advanced software that reads and analyzes thousands of scientific publications and patents to discover new ways to speed solar energy technology innovation and commercialization. Meanwhile, Massachusetts Institute of Technology and the University of North Carolina–Charlotte will apply computational tools to patent, cost, and production data to speed up solar technology cost reductions and better forecast future cost reductions for new energy technologies.

The seven projects announced today will provide new insights that could dramatically accelerate the commercialization of affordable, reliable clean energy technologies. See the full list of projectsPDF.

The SunShot Initiative is a collaborative national effort to make solar energy cost-competitive with other forms of energy by the end of the decade. Inspired by President Kennedy’s “Moon Shot” program that put the first man on the moon, the SunShot Initiative has created new momentum for the solar industry by highlighting the need for American competitiveness in the clean energy race. For more information, visit www.energy.gov/sunshot.

 

Read the original blog entry...

More Stories By Bob Gourley

Bob Gourley, former CTO of the Defense Intelligence Agency (DIA), is Founder and CTO of Crucial Point LLC, a technology research and advisory firm providing fact based technology reviews in support of venture capital, private equity and emerging technology firms. He has extensive industry experience in intelligence and security and was awarded an intelligence community meritorious achievement award by AFCEA in 2008, and has also been recognized as an Infoworld Top 25 CTO and as one of the most fascinating communicators in Government IT by GovFresh.

@ThingsExpo Stories
Connected devices and the Internet of Things are getting significant momentum in 2014. In his session at Internet of @ThingsExpo, Jim Hunter, Chief Scientist & Technology Evangelist at Greenwave Systems, examined three key elements that together will drive mass adoption of the IoT before the end of 2015. The first element is the recent advent of robust open source protocols (like AllJoyn and WebRTC) that facilitate M2M communication. The second is broad availability of flexible, cost-effective storage designed to handle the massive surge in back-end data in a world where timely analytics is e...
How do APIs and IoT relate? The answer is not as simple as merely adding an API on top of a dumb device, but rather about understanding the architectural patterns for implementing an IoT fabric. There are typically two or three trends: Exposing the device to a management framework Exposing that management framework to a business centric logic Exposing that business layer and data to end users. This last trend is the IoT stack, which involves a new shift in the separation of what stuff happens, where data lives and where the interface lies. For instance, it's a mix of architectural styles ...
The Internet of Things will put IT to its ultimate test by creating infinite new opportunities to digitize products and services, generate and analyze new data to improve customer satisfaction, and discover new ways to gain a competitive advantage across nearly every industry. In order to help corporate business units to capitalize on the rapidly evolving IoT opportunities, IT must stand up to a new set of challenges. In his session at @ThingsExpo, Jeff Kaplan, Managing Director of THINKstrategies, will examine why IT must finally fulfill its role in support of its SBUs or face a new round of...
We are reaching the end of the beginning with WebRTC, and real systems using this technology have begun to appear. One challenge that faces every WebRTC deployment (in some form or another) is identity management. For example, if you have an existing service – possibly built on a variety of different PaaS/SaaS offerings – and you want to add real-time communications you are faced with a challenge relating to user management, authentication, authorization, and validation. Service providers will want to use their existing identities, but these will have credentials already that are (hopefully) i...
Cultural, regulatory, environmental, political and economic (CREPE) conditions over the past decade are creating cross-industry solution spaces that require processes and technologies from both the Internet of Things (IoT), and Data Management and Analytics (DMA). These solution spaces are evolving into Sensor Analytics Ecosystems (SAE) that represent significant new opportunities for organizations of all types. Public Utilities throughout the world, providing electricity, natural gas and water, are pursuing SmartGrid initiatives that represent one of the more mature examples of SAE. We have s...
"Matrix is an ambitious open standard and implementation that's set up to break down the fragmentation problems that exist in IP messaging and VoIP communication," explained John Woolf, Technical Evangelist at Matrix, in this SYS-CON.tv interview at @ThingsExpo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
The Internet of Things will greatly expand the opportunities for data collection and new business models driven off of that data. In her session at @ThingsExpo, Esmeralda Swartz, CMO of MetraTech, discussed how for this to be effective you not only need to have infrastructure and operational models capable of utilizing this new phenomenon, but increasingly service providers will need to convince a skeptical public to participate. Get ready to show them the money!
One of the biggest challenges when developing connected devices is identifying user value and delivering it through successful user experiences. In his session at Internet of @ThingsExpo, Mike Kuniavsky, Principal Scientist, Innovation Services at PARC, described an IoT-specific approach to user experience design that combines approaches from interaction design, industrial design and service design to create experiences that go beyond simple connected gadgets to create lasting, multi-device experiences grounded in people's real needs and desires.
P2P RTC will impact the landscape of communications, shifting from traditional telephony style communications models to OTT (Over-The-Top) cloud assisted & PaaS (Platform as a Service) communication services. The P2P shift will impact many areas of our lives, from mobile communication, human interactive web services, RTC and telephony infrastructure, user federation, security and privacy implications, business costs, and scalability. In his session at @ThingsExpo, Robin Raymond, Chief Architect at Hookflash, will walk through the shifting landscape of traditional telephone and voice services ...
Scott Jenson leads a project called The Physical Web within the Chrome team at Google. Project members are working to take the scalability and openness of the web and use it to talk to the exponentially exploding range of smart devices. Nearly every company today working on the IoT comes up with the same basic solution: use my server and you'll be fine. But if we really believe there will be trillions of these devices, that just can't scale. We need a system that is open a scalable and by using the URL as a basic building block, we open this up and get the same resilience that the web enjoys.
The Internet of Things is tied together with a thin strand that is known as time. Coincidentally, at the core of nearly all data analytics is a timestamp. When working with time series data there are a few core principles that everyone should consider, especially across datasets where time is the common boundary. In his session at Internet of @ThingsExpo, Jim Scott, Director of Enterprise Strategy & Architecture at MapR Technologies, discussed single-value, geo-spatial, and log time series data. By focusing on enterprise applications and the data center, he will use OpenTSDB as an example t...
The Domain Name Service (DNS) is one of the most important components in networking infrastructure, enabling users and services to access applications by translating URLs (names) into IP addresses (numbers). Because every icon and URL and all embedded content on a website requires a DNS lookup loading complex sites necessitates hundreds of DNS queries. In addition, as more internet-enabled ‘Things' get connected, people will rely on DNS to name and find their fridges, toasters and toilets. According to a recent IDG Research Services Survey this rate of traffic will only grow. What's driving t...
Enthusiasm for the Internet of Things has reached an all-time high. In 2013 alone, venture capitalists spent more than $1 billion dollars investing in the IoT space. With "smart" appliances and devices, IoT covers wearable smart devices, cloud services to hardware companies. Nest, a Google company, detects temperatures inside homes and automatically adjusts it by tracking its user's habit. These technologies are quickly developing and with it come challenges such as bridging infrastructure gaps, abiding by privacy concerns and making the concept a reality. These challenges can't be addressed w...
Explosive growth in connected devices. Enormous amounts of data for collection and analysis. Critical use of data for split-second decision making and actionable information. All three are factors in making the Internet of Things a reality. Yet, any one factor would have an IT organization pondering its infrastructure strategy. How should your organization enhance its IT framework to enable an Internet of Things implementation? In his session at Internet of @ThingsExpo, James Kirkland, Chief Architect for the Internet of Things and Intelligent Systems at Red Hat, described how to revolutioniz...
Bit6 today issued a challenge to the technology community implementing Web Real Time Communication (WebRTC). To leap beyond WebRTC’s significant limitations and fully leverage its underlying value to accelerate innovation, application developers need to consider the entire communications ecosystem.
The definition of IoT is not new, in fact it’s been around for over a decade. What has changed is the public's awareness that the technology we use on a daily basis has caught up on the vision of an always on, always connected world. If you look into the details of what comprises the IoT, you’ll see that it includes everything from cloud computing, Big Data analytics, “Things,” Web communication, applications, network, storage, etc. It is essentially including everything connected online from hardware to software, or as we like to say, it’s an Internet of many different things. The difference ...
Cloud Expo 2014 TV commercials will feature @ThingsExpo, which was launched in June, 2014 at New York City's Javits Center as the largest 'Internet of Things' event in the world.
SYS-CON Events announced today that Windstream, a leading provider of advanced network and cloud communications, has been named “Silver Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9–11, 2015, at the Javits Center in New York, NY. Windstream (Nasdaq: WIN), a FORTUNE 500 and S&P 500 company, is a leading provider of advanced network communications, including cloud computing and managed services, to businesses nationwide. The company also offers broadband, phone and digital TV services to consumers primarily in rural areas.
"There is a natural synchronization between the business models, the IoT is there to support ,” explained Brendan O'Brien, Co-founder and Chief Architect of Aria Systems, in this SYS-CON.tv interview at the 15th International Cloud Expo®, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
The major cloud platforms defy a simple, side-by-side analysis. Each of the major IaaS public-cloud platforms offers their own unique strengths and functionality. Options for on-site private cloud are diverse as well, and must be designed and deployed while taking existing legacy architecture and infrastructure into account. Then the reality is that most enterprises are embarking on a hybrid cloud strategy and programs. In this Power Panel at 15th Cloud Expo (http://www.CloudComputingExpo.com), moderated by Ashar Baig, Research Director, Cloud, at Gigaom Research, Nate Gordon, Director of T...