Can't create user that will login with a key #368

Activity

1. jafreck commented on Feb 5, 2018

   

   Jake Freck (jafreck)

   on Feb 5, 2018

   Member

   More actions

   It doesn't appear like you are doing anything wrong. All of your steps look correct. Just to clarify, are you creating a user when you create the cluster? Or are you trying to add a user after the cluster is created?

   I just tried to reproduce this issue and was not able to do so. I can add a user and ssh into the cluster as expected using an ssh-key. Do you have a corresponding private key for the public key you are supplying?
2. Jake Freck (jafreck)

   added

   bug

   on Feb 5, 2018
3. stefangordon commented on Feb 5, 2018

   

   Stefan Gordon (stefangordon)

   on Feb 5, 2018

   Author

   More actions

   So my initial create flow went like this:

   (aztk) root@DESKTOP-8SBD5UP:/mnt/e/code/aztk# aztk spark cluster create --id cluster1 --size 2
   -------------------------------------------
   spark cluster id:        cluster1
   spark cluster size:      2
   >        dedicated:      2
   >     low priority:      0
   spark cluster vm size:   Standard_NV6
   custom scripts:          [{'script': 'custom-scripts/jupyter.sh', 'runOn': 'master'}]
   subnet ID:               None
   file shares:             0
   docker repo name:        aztk/python:spark2.2.0-python3.6.2-gpu
   wait for cluster:        False
   username:                spark
   -------------------------------------------
   Cluster cluster1 is being provisioned.
   
   
   
   (aztk) root@DESKTOP-8SBD5UP:/mnt/e/code/aztk# aztk spark cluster ssh --id cluster1
   -------------------------------------------
   spark cluster id:    cluster1
   open webui:          http://localhost:8080
   open jobui:          http://localhost:4040
   open jobhistoryui:   http://localhost:18080
   open jupyter:        http://localhost:8888
   open namenodeui:     http://localhost:50070
   open rstudio server: http://localhost:8787
   ssh username:        spark
   connect:             True
   -------------------------------------------
   The authenticity of host '[20.190.59.127]:50000 ([20.190.59.127]:50000)' can't be established.
   ECDSA key fingerprint is 52:bf:d9:fa:31:ee:0f:ad:c1:1d:1c:27:eb:6e:b7:9e.
   Are you sure you want to continue connecting (yes/no)? yes
   Warning: Permanently added '[20.190.59.127]:50000' (ECDSA) to the list of known hosts.
   Password:
   Password:
   Password:
   Connection closed by 20.190.59.127
   

   and my secrets.yaml looks like this (excluding service principal):

   default:
       # SSH keys used to create a user and connect to a server.
       # The public key can either be the public key itself (ssh-rsa ...) or the path to the ssh key.
       ssh_pub_key: ~/.ssh/id_rsa.pub
       ssh_priv_key: ~/.ssh/id_rsa
   

   (those key files exist with RSA keys in them).

   So I assumed that was creating the spark user automatically with that key. I then tried creating a new user with the key and had a similar issue. Using bash-on-windows if relevant.

   (aztk) root@DESKTOP-8SBD5UP:/mnt/e/code/aztk# aztk spark cluster add-user --id cluster1 --username stefan --ssh-key ~/.ssh/id_rsa.pub
   -------------------------------------------
   spark cluster id:    cluster1
   username:            stefan
   -------------------------------------------
   ssh public key:      -----BEGIN PUBLIC KEY-----
   MIGeMA0GCSqGSIb3DQEBAQUAA4GMADCBiAKBgHU1OxsPFWYSQESHcJ6b/EaI32az
   RPCqffHsCysefAPlwH3FJ3q8jt3CpSJIPiPA9FuDmmfbapSe0+5TFnlEhO+AcBBN
   XJnVVsy7kr99Z885KX776j6CF2Tonbm6+smRg1fE6udL85vrEk6qgoHxQ2WzqgbO
   vSNy8VaSxHhcV53BAgMBAAE=
   -----END PUBLIC KEY-----
   
   -------------------------------------------
   (aztk) root@DESKTOP-8SBD5UP:/mnt/e/code/aztk# aztk spark cluster ssh --id cluster1 --username stefan
   -------------------------------------------
   spark cluster id:    cluster1
   open webui:          http://localhost:8080
   open jobui:          http://localhost:4040
   open jobhistoryui:   http://localhost:18080
   open jupyter:        http://localhost:8888
   open namenodeui:     http://localhost:50070
   open rstudio server: http://localhost:8787
   ssh username:        stefan
   connect:             True
   -------------------------------------------
   Password:
   
4. jafreck commented on Feb 5, 2018

   

   Jake Freck (jafreck)

   on Feb 5, 2018

   Member

   More actions

   To rule out that this being issue with the keypair, can you generate a new pair of keys and test with those?

   Everything you've outlined looks correct, but when I follow your steps I'm still not able to reproduce. The spark user created by default should be created using the keys specified in secrets.yaml which makes me think this is an issue with the private key not matching the public key.
5. stefangordon commented on Feb 5, 2018

   

   Stefan Gordon (stefangordon)

   on Feb 5, 2018

   Author

   More actions

   Totally makes sense, will do.
6. stefangordon commented on Feb 6, 2018

   

   Stefan Gordon (stefangordon)

   on Feb 6, 2018

   Last edited by stefangordon

   Author

   More actions

   It was indeed a key problem (of some sort, not entirely sure what - but freshly created ones worked fine). Sorry for the trouble, thanks!
7. Stefan Gordon (stefangordon)

   closed this as completedon Feb 6, 2018