Posts Tagged ‘Cloud computing’

SuperVIEW Version 1.4

Friday, December 4th, 2009 by Jo Deeker

Every month we release a new build of SuperVIEW and the team behind the development are Agile masters. Each build contains new and improved features for data geeks, new visualizations, and of course fixes for the bugs… we even go on safaris to find them.

Hybrid Cloud Service

The SuperVIEW Hybrid Cloud Service consists of two components:

  • The SuperVIEW Web application in a cloud service provided by the Google App Engine.
  • The application is connected to the ‘back-end’ SuperSTAR server that cross-tabulates and processes the data.

Learn more about the Hybrid Cloud Service ….

Showcase Visualizations

Top-N charts

Top-N charts sort and filter datasets to provide an easy visual comparison of relative data event sizes. They allow you to integrate very large classifications into SuperVIEW sites by filtering in only the Top-N items in a given query. For example the top 10 locations out of 100.

Top N Chart

Population Pyramid

The Population Pyramid enables a visualization of demographic trends through population pyramids that stack two distributions back to back and side by side.

Population pyramid

Previews of New Visualizations

Dual-axis Chart

The Dual Axis Chart plots two data series against each other.

Dual-axis Chart

Timeline Chart

The Timeline Chart is based on the Google Visualization API. This chart allows you to select a time period from a scale at the base of a chart, and then see the data updated and stretched to fit the width of the screen. You can also zoom in and out of a time range.

time-line-chart

Side-by-Side Pie Charts

This allows you to view two pie charts side-by-side.

Side-by-side Pie Charts

Features for Data Geeks

Dynamic Recodes

The configuration of the dynamic recodes feature used in the Data Selection Experience has been streamlined. You now can multi-select or de-select filters.

Want more

Contact Space-Time Research if you want more information or leave us a comment in this blog post.

We’re in the cloud! SuperWEB available now

Thursday, October 1st, 2009 by Jo Deeker

I’m really excited to announce that we aim to be among the first companies to host applications on the Apps.gov website.

To get there, we needed to get SuperWEB up into the cloud, and this week, we hosted our first application on the Amazon EC2 cloud. Yesterday, I got my first Amazon bill - $10 / day so far and we uploaded a lot of data!

Background:

Vivek Kundra, the US Federal Chief Information Officer, has launched the new Apps.gov Storefront to enable US Federal Government agencies to buy cloud computing services as easily as a consumer can acquire a Gmail or Facebook account.

Cloud computing services reduce costs through reductions in purchasing and maintaining servers, while simultaneously improving service scalabilty to manage peaks and troughs in usage. Kundra says that besides encouraging better collaboration among agencies, he expects cloud services to reduce energy consumption because agencies will be able to share IT infrastructures.

Space-Time Research is responding to the recent US Federal Government request for proposal for applications to be hosted via the Apps.gov website. The Apps.gov Storefront is managed by the US GSA (General Services Administration) and SuperSTAR software is already available for purchase through the GSA e-Library.

Space-Time Research cloud offerings

In September, Space-Time Research initiated a cloud offering by hosting SuperWEB Software as a Service (SaaS) on the Amazon EC2 cloud service. SuperWEB is currently in the process of being assessed for inclusion in the Apps.gov website. Once certified, SuperWEB SaaS will be available to buy as a small, medium, large or extra large implementation on a pay-by-month basis.

At the end of October, SuperVIEW will be production-ready and available via a Google App Engine hybrid cloud service. For more information, see SuperVIEW hybrid cloud service.

More about Apps.gov

Apps.gov is managed by the GSA development team, which is led by Casey Coleman, GSA’s CIO. In the article Kundra’s great experiment: Government apps ’store front’ opens for business, Coleman says:

“Through Apps.gov, GSA can take on more of the procurement processes upfront, helping agencies to better fulfill their missions by implementing solutions more rapidly,”

“We will also work with industry to ensure cloud-based solutions are secure and compliant to increase efficiency by reducing duplication of security processes throughout government.”

Jo Deeker

Open Data Initiative - Free SuperVIEW hosting of data

Monday, August 17th, 2009 by Jo Deeker
Open Data Initiative

Open Data Initiative

Space-Time Research this week launced a new program called the Open Data Initiative at the International Statistical Institute (ISI) 2009 conference in Durban.

What is the Open Data Initiative?

The Open Data Initiative is a Web 2.0 site for disseminating public data. Users discover and explore data in a rich, interactive, and intuitive application, rather than browse or read large documents of published tables and charts. The end user can select and visualize any combination of data. It can be exported, printed, linked to, and shared in collaboration environments.

The Open Data Initiative is a freely available online service for the creation and dissemination of data for public consumption. You have the data; we have the service to disseminate it to the public.

The Open Data Initiative is hosted on the Google AppEngine Cloud, enabling providers of public data to create engagingand rich Web 2.0 experiences built on top of Space?Time Research’s SuperVIEW product suite. This provides transparent, lightning?fast web traffic responsiveness, scalability and built in redundancy no matter where in the world you are.

Data types suitable for the Open Data Initiative: Health, Transport, Education, Agriculture, Population Statistics, Labour Force, etc.

How do I sign up?

Contact us via the Open Data Initiative website

Key Benefits. The Open Data Initiative:

  • Is Cost and Time Efficient — Reduces the workload on your data analysts and researchers.
  • Provides Data that is Complete — Why compromise on providing a subset of the data? Maximize the ability of the public to self?service data of personal interest.
  • Provides Data as Service — Now you can provide a new online data service to the public.
  • Protects the Relevance of Your Brand — Provide an engaging and rewarding experience for the public. This reinforces the relationship of trust they have in your organization.
  • Delivers Data Integrity — Have confidence that the public are seeing the right numbers, graphs, and maps, andreaching the correct interpretation and understanding behind those numbers.
  • Delivers Data Responsiveness — Minimize the time between data collection and data dissemination to ensure maximum relevancy of the data to the audience.
  • Creates Communities of Users — Ensure the online experience can be captured and shared by the public incollaborative environments from Blogs to Twitter.

Frequently asked questions coming from some of our early adopters:

Q. What is the business model for Space-Time Research?
A. This is a free service and as such it has business model restrictions for customers - they cannot charge a fee for access to their created sites. It must be public and not sit behind authentication or payment gateways. We have a paid service available that overcomes these restrictions but this is a good way to test drive the technology and the dissemination approach using the free service initially. Alternatively customers can purchase a paid SuperVIEW software license and implement their own business model around a deployed SuperVIEW.

Q. What about confidentiality?
No confidentiality capabilities are offered with the free SuperVIEW. The Open Data Initiative will host all data in the Cloud so by it’s nature data provided should not contain confidential information. We can provide a confidential Cloud based service using our Hybrid connector, but this becomes a paid solution engagement.

Q. How do statistical boundaries get loaded?
We will detail this in the data collection process over the next week with people that sign up to our early adopter program, but think it will be along the lines of providing a shapefile (with some size limits — i.e. pre-simplified and for particular areas) or KML to us.

Q. How does the application get integrated with the data providers website.

Option 1 -> provide a link that takes the user from the data provider website to the Open Data Initiative website.
Option 2 -> use an IFRAME to embed the Open Data Initiative hosted site into their website.

Jo Deeker

My favourite Cloud Reading List / Resources

Friday, August 7th, 2009 by Jo Deeker

A sampler of general resources I have found useful:

http://www.cloudbook.net/
A great site - good definitions, interesting information. Written mostly by vendors. I’m signed up to be a contributor.

http://www.opencloudmanifesto.org/
I’m not a fan of the word manifesto but this is a group that believes that cloud offerings should be open and compatible with each other. Good definitions as well, and good ideas.

http://cloudcomputing.ulitzer.com/
Very interesting articles on this site, but as you will see, the advertising and navigation is annoying. Persevere.

Specfic articles / resources:
http://www.gcn.com/Blogs/Tech-Blog/2009/03/Google-App-Engine.aspx
I found this when I googled “does google app engine have an SLA”. Gold.

http://www.networkworld.com/news/2008/070208-cloud.html
Gartner’s 7 cloud computing risks article

http://www.misaustralia.com/viewer.aspx?EDP://1249365190099
Another beware of risk article - this time from an Australian Government perspective.

http://code.google.com/appengine/docs/quotas.html

The definitive pricing document for Google App Engine and how the quotas work.

http://www.govtech.com/gt/articles/702119?utm_source=newsletter&utm_medium=email&utm_campaign=GTEN_2009_7_15
Kundra’s continued support of the idea is what makes me think it’s all going to happen.

Amazon EC2 links:

Jo Deeker

SuperSTAR and Cloud - nutting through the details of Google Apps Engine

Friday, August 7th, 2009 by Jo Deeker

I have spent the past week further working through the details of cloud offerings and how it can be used by existing and new SuperSTAR customers. It’s still a hot topic, and I’m still sure it’s a really good thing and something that we should be offering our customers if they want it.

So far, Space Time Research has put our SuperVIEW software into the Google App Engine cloud and demonstrated that it works just fine. We’re confident that we’re addressing many of the security concerns associated with clouds because we’ve chosen to go with a hybrid model, where the core database and SuperSERVER software still resides in the client’s own server environment. It’s just the application itself that is in the cloud. The data that is passed to the application is aggregated and encrypted already and something that would be passed to the web browser and then to the user regardless of whether the app is hosted in a cloud or not. So most of the security / data location concerns are not an issue with this model. [Aside: it will be for our SuperWEB product so we need to come up with a different way of handling that.]

At the risk of repeating myself, I do see some clear benefits of using this model over an internally hosted web server:

  • For clients who already have a SuperSTAR infrastructure, external web hosting can sometimes be difficult to arrange. This is an easy and inexpensive way to get around it.
  • Clients can take advantage of the scalability offered and handle peak loads without having to buy massive servers.
  • Of course, there’s others. They’re in last week’s blog.

So now we have a viable demonstration to show customers. The next question I had to answer was - if a customer wants it, would it work for them in a production setting? How scalable is it really? Is it true that there is no SLA for the Google App Engine? And how much would it cost and for what? Here’s what I found out:

  • It’s true that there is no SLA for the Google App Engine. I reckon this rules out half of our customers straight away. Especially those who are data providers like the Australian Bureau of Statistics and want to reliably provide access to data and analytical tools to the world 24/7. Other customers, such as those who use our software for internal or researcher use, or those who are just starting out with SuperVIEW, might take this risk on board and try it out.
  • It’s really difficult to work out what it would actually cost. Everything is costed by usage per day and there’s the option of getting a free service that then jumps into a paid service, or a paid service that gets more expensive as your user base grows. What we did work out was that it would be free for most SuperVIEW applications up to 2,000 user sessions per day. After that, it would cost approximately $300 USD per month to add an additional 1,000 users.

Conclusion:

Using the Google App Engine for SuperVIEW is a good way for us to get started with a real cloud offering. We can do this cheaply, and we can pilot and test it over the next 6 months with some of our customers. Space-Time Research needs to provide alternatives for our customers so they can make informed decisions about which method to go with.

We know we have cloud-enabled software and maybe this is enough for now. Our software doesn’t work on every cloud (e.g. by definition it won’t work on Microsoft Azure because our application is java-based), but it operates in virtual environments and can be hosted securely in some way outside a customer’s server environment.

We need to understand more about the potential governmental restrictions - in particular what it means for Australia, the US and the EU which is where most of our customers come from. And what our customers expect us to do for them - do they want us to find the provider, or just provide assurance that our software will work in the cloud of their choosing? There is no point in us going down a path of recommending certain providers and finding out that the government would NEVER choose them.

A whole other topic, and one I will not write about but the gov2.0 thinkers are writing about, is the public servant aversion to risk and change that means that it’s possible no-one wants to really do this anytime soon.

Next steps:

  • I am preparing a white paper for our sales team and customers on what we offer now and intend to offer in the future. This will have enough technical details to be able to talk to project owners / sponsors, but IT representatives will need more detail.
  • I’m finding out as much as I can about what governs our customer decisions now. I’m keen to get help on that because it’s really hard to find out.
  • I’m talking to Gartner analysts to get their take. Particularly as the article I’m sent most often is one that Gartner wrote about the security concerns of cloud and what to watch out for.
  • I’m talking to a real cloud provider - Telstra - who are an Australian provider and who are going to host all of Visy Recycling’s applications which is a significant move.
  • I’m going to ask questions of the Australian gov2.0 taskforce and see what they think about it.
  • I’m going to keep reading the articles I get sent every day.

Reflection:

Even though there is so much information out there, and so many articles and blogs being written about cloud computing at the moment, there is no one-stop answer shop that answers my questions. As I’ve been searching and figuring things out this week, I’ve really wished that I could just pick up the phone and call the Google App Engine product manager and talk to a real person. As I write, I realise I could have at least tried. This week’s resolution is to ask more questions of real people via whatever means is appropriate.

Jo Deeker

Cloud Computing Services at Space-Time Research

Tuesday, July 28th, 2009 by Jo Deeker

I have been doing a lot of reading about cloud computing and concerns over security of data. In case you hadn’t noticed, cloud computing is a hot topic and IT magazines and blogs are overflowing with articles. Kundra is talking about it (Kundra courts the risk of innovation — Government Computer News ), Gov 2.0 and Data.gov encourage it, and some US city departments are investigating moving all their services into a cloud (L.A. weighs plan to replace computer software with Google service - Los Angeles Times )

At first I wondered what all the fuss was about - it’s only third party hosting of applications after all, and it’s already been done – A LOT. Over the last few weeks I’ve delved a bit deeper, and discovered that my understanding of the technology, and options available, was limited. There are a number of different ways applications can be hosted or delivered via a cloud, and putting your application on a separate server housed at an external provider, which is what we do for some of our existing clients, is a very simple but expensive way to do it. I’ve since discovered there are other ways that might be better.

I have worked at and with large organizations over the last 20 years, and I understand why the idea of moving applications into a cloud is attractive. Sometimes it can be nearly impossible for a business unit within an organization to get a server or space on a server to host applications. And if you can get one, for some organizations, it can cost up to hundreds of thousands of dollars even if the server itself only cost a few thousand. Here we have an opportunity to get rid of one of the major stumbling blocks in putting a new application (particularly a web-application) out there.

The potential benefits of cloud computing are clear:

  • It can be MUCH cheaper. We’ve worked out that a basic SuperVIEW application could be hosted for under sixty dollars a month (depending on number of users etc.) This compares with an external hosting service cost of $1500 AUD per month for a dedicated server.
  • It removes constraints imposed by IT departments, or even harder to deal with, IT Service Providers. The approvals to host applications on internal servers can be onerous.
  • It can offer scalability to scale up or down, particularly when there is an initial peak load. I’m hoping that when we launch 2011 census data online with the Australian Bureau of Statistics that we can use cloud resources to cope with our initial peak loads.
  • As the hardware and infrastructure are already available, it can be very quick to deploy at application and use it. No more waiting for the server to be ready.

The major considerations are:

  • Some cloud services offerings won’t tell you or guarantee where your data is stored and this makes some organizations nervous.
  • The technology and different options available are new and don’t necessarily follow strict government security procedures. I figure that by the time some government organizations are ready to launch an application it will sorted out.
  • Working out your optimal pricing can be a little tricky - it’s a bit like a mobile phone plan and if you don’t know how your system is going to be used, it can be hard to work out which is the most cost-effective model.

We have recently come up with a couple of cloud offerings for our SuperVIEW software that offer the best of both worlds for SuperSTAR customers. Our customers have given us some direct feedback that they are very interested in cloud models for hosting web applications, but they would like to keep their data in-house. This is not simply an issue of security; all of our customers have substantial data management systems in place, either fully in-house, or connected to privately outsourced data centres. Having the data for SuperVIEW hosted in-house ensures that the provider retains full ownership and does not have to extend its data management policies to address the differences that cloud computing would introduce.

Our HYBRID model fits this bill. The SuperVIEW application is hosted on a cloud provided by the Google App Engine. Via a secure data connector developed by STR, the application connects to a customer’s existing SuperSTAR database housed internally. Encrypted, aggregated data is returned to the web application for analysis and visualization in the SuperVIEW web client. Because SuperSTAR databases are read-only, and cannot be manipulated by SQL or other programs, the raw data is secure and is not vulnerable to alteration or attack.

We also want offer the ability to experience the whole SuperSTAR application in a cloud using a different service provider . Currently, we do provide fully hosted dedicated-server solutions, and over the next month we are working out who best to source these services from in a more distributed environment. There are some customers who will always want to keep their data management tools in-house, but others may want to migrate the whole solution to a cloud. We expect to be able to provide a hybrid, or fully cloud-based SuperSTAR service to customers with the next release of our software in the next month or so.

Until next time,

Jo