Memo-migrated‎ > ‎

My FAQ for AWS Services

posted Sep 11, 2013, 3:22 PM by Teng-Yok Lee   [ updated Jan 2, 2021, 8:45 PM ]

General

Where are other documents?

A: The manual of all AWS APIs can be seen here: http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/index.html.

How to add it to existed Java projects in Eclipse?

A: Add the AWS Java SDK to the build path (Ref: http://aws.amazon.com/articles/3586).

How to solve the error "java.lang.NoSuchMethodError" when new a credential?

A: If using GWT, change the class build path of GWT and AWS. (Ref: http://stackoverflow.com/questions/11103325/amazon-credentials-method-not-found)

EMR

Where are other documents?

Here is a Best Practice Guide for EMR. Other documents are on http://aws.amazon.com/documentation/elasticmapreduce/.

A tutorial for Hadoop streaming:
Writing Hadoop Applications in Python with Hadoop Streaming, http://users.sdsc.edu/~glockwood/di/hadoop-streaming.php

How to connect to the JobTracker on the master node?

Just type
lynx http://localhost:9100

How to connect to the JobTracker on the master node via browser?

A: The key is to build the SSH tunnel because the web GUI of job tracker is supposed to only be connected by the master only. Consequently, it is needed to build the SSH tunnel that maps local ports to the ports 9100/9103 of the master.

To set up the ssh on Windows, we can use putty. So far I cannot make it works with FoxyProxy, but here is my procedure to make it work (partially):

  1. Go to Session.
  2. Set Host Name (or IP Address) as the IP or public DNS of the master node to .
  3. Go to Connection->SSH->Tunnels.
  4. Set source port as 9100, Local, and set destination as <ip-master-node>:9100.
  5. Click Add.
  6. Set source port as 9103, Local, and set destination as <ip-master-node>:9103.
  7. Click Add.
  8. Click the button Open.
  9. Now open the browser and put the address as http://localhost:9100.
  10. When connecting to <ip-master-node>:9103, change it to http://localhost:9103.
Comments