Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove_alias.sh lead to errors using InetAddress.getLocalHost.getHostAddress #1

Closed
clakech opened this issue Aug 5, 2015 · 1 comment

Comments

@clakech
Copy link

clakech commented Aug 5, 2015

Hi,

Thanks for sharing your work, I am now running a spark cluster in minutes on my laptop, cool!

But when I submit some code to the cluster, it fails because of the remove_alias workaround.

When I try to use InetAddress.getLocalHost.getHostAddress I face an exception:

java.net.UnknownHostException: 34a5ed171df7: Name or service not known

The code I am using is the spark-cassandra-connector. The exception is thrown here: https://github.com/datastax/spark-cassandra-connector/blob/v1.3.0-RC1/spark-cassandra-connector/src/main/scala/com/datastax/spark/connector/cql/CassandraConnectorConf.scala#L108

If I remove the remove_alias from the spark-shell launcher, the spark-cassandra-connector works but later when spark "deploy" the submitted code to its cluster of worker, there is an error because the nodes try to use their internal names to communicate.

Seems like a linking problem. I will trying to remove the remove_alias workaround and to link each node properly for them to communicate using their names

@clakech
Copy link
Author

clakech commented Aug 6, 2015

I may a found a solution to this by solving the remove_alias workaround properly #2

@clakech clakech closed this as completed Aug 6, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant