Frequently Asked Questions

What is this site?

This site allows users to launch, configure, and terminate HPCC Systems Thor clusters at the push of a button. It also gathers and organizes additional information you may need to manage these clusters.

You can learn more about the HPCC Platform at hpccsystems.com.

Who pays for this usage?

Users are responsible for all Amazon charges. HPCC Systems is just providing an easier way of starting a cluster on the Amazon AWS environment.

Is this cloud provided by HPCC Systems?

Amazon.com provides this cloud service. HPCC Systems is just facilitating the creation of a cluster.

Is this equivalent to the Amazon EMR?

No. That will come later. HPCC Systems is using the Amazon AWS (Amazon Web Services) platform to help you create Thor Clusters. This is not the ideal environment but will allow users to test and explore the HPCC Systems Thor platform at ease and low cost.

When will the EMR equivalent be available?

HPCC Systems is working with Amazon to create a similar service to EMR (Elastic Mapreduce). Since the HPCC Systems platform does not use the limited data model of Mapreduce, the name should change. Internally, HPCC Systems is using "EECL" for Elastic ECL. ECL is the data centric, cluster aware, big data declarative language that the HPCC Systems platform uses.

What are some of the limitations of this implementation (EC2 AWS) vs an EMR equivalent?

Where can I get some ECL examples to try in my test cluster?

HPCC Systems has a growing set of ECL examples on the web site: ECL Examples.

Your contributions are also welcome.

What about security?

Your AWS Access Key ID and AWS Secret Access Key are not stored on this system.
Cookies are cryptographically signed to prevent tampering and are encrypted in flight via HTTPS.

Recommendations:

  • Create an AWS Access Key specifically for use on this site.
  • Deactivate your AWS Access Key when not in use.
  • Download and delete your clusters' ssh key from this site once each cluster is ready.
  • Log out of this site when not in use.
  • Clear your cookies when accessing this site from an unsecure computer.

Manage Your AWS Access Keys

How can I get support?

Visit HPCC Systems Support Forums for free community support. Enterprise level support is also available. Please contact us for details.

What if I need additional support beyond the "free" forums?

Enterprise level support is also available. Please contact us for details.

Will it work from my Mac?

Will it work from my Linux workstation?

How big of a cluster can I build? Any limitations? Recommendations?

Is there information available around the "support nodes" that get created?

What will I see in my Amazon AWS Management Console?

When you launch a new cluster, you will see one new EC2 instance for each node in your cluster. You will also see a new security group configured specifically for your new cluster and a new key pair. Both will have the same name as your cluster.

When you terminate a cluster, the site will terminate those EC2 instances that have a security group and key pair with the same name as your cluster. The site will then delete the security group and key pair from your Amazon AWS account.

What is the difference between One-Click cloud and the AWS support for HPCC previously announced?

Can I still use the Amazon console and other AWS tools to manage the One-Click created Thor? How?

What happens to my clusters when I log out of this site?

Nothing. This system interacts with your Amazon AWS account. When you log out of this site, your cluster will continue to run on Amazon AWS until you terminate them either from this site or from your Amazon AWS Management Console.

What if I navigate away from the log page while it's busy?

The site will continue to fulfill your request and accept new requests. This is true even if you log out. You can navigate back to this page by going to the "View Clusters" page and clicking on the "View Log" link for the cluster in question.

Why did my cluster fail to configure?

The most common reason is that you have a new Amazon AWS account. Even though you have credentials from Amazon, it still takes a while for Amazon to fully enable your account. You're almost there. Try again in an hour or two.

The second most common reason is that you requested a cluster size that would cause you to exceed the default limits imposed by Amazon. At the time of this writing, Amazon sets that default limit to no more than 20 total EC2 instances per account. Don't worry -- many people launch significantly larger clusters on Amazon. Use the link "AWS Limit Increase Request" to request a limit increase. You will need to know that this site currently launches "Large" "Linux" instances in the "US East" region by default. You will also need your account number found in the upper right hand corner of the AWS Access Keys page.

It is possible that Amazon is running slow. Check the link "AWS Health Dashboard" to see if Amazon AWS is experiencing issues.

If none of these apply, please reach out via the "Comments" link or the "Forum" link.

What can I do when I try to start a cluster and it hangs or parts of the process (per log) fail?

Use the Abort Cluster control/button (currently in development) from our main page, and/or go to the Amazon AWS Management EC2 Console, (login into the AWS system), find the cluster in question and terminate it.

How can I store my data in this environment?

Is S3 supported? If so, how can I access it?

Can I change some of the default used to run this cool One-Click Thor script? If so, how?

Can I have an API or programmatic interface to the cluster?

Regarding the HPCC Systems Roxie, will One-Click Roxie be available soon?

How could I leverage a Thor cluster in Amazon with an in-house Roxie?