Re: AW: AW: AW: AW: Using nodelist file causes namd to hang

From: Douglas Houston (DouglasR.Houston_at_ed.ac.uk)
Date: Thu Jun 19 2014 - 04:56:28 CDT

Thanks Norman,

Not sure if this is relevant, but If I specify any one node in the
nodelist file it runs OK, it only hangs if I have more than one node
listed. Whether the node is on the same or different subnet seems to
make no difference.

How do I check that all the nodes can reach each other over the
network? I can ssh from one to the other OK (without password), what
else should I check? We do have firewalls in place obviously but how
can I tell if this is the problem?

cheers,
Doug

Quoting Norman Geist <norman.geist_at_uni-greifswald.de> on Thu, 19 Jun
2014 09:19:03 +0200:

> The behavior you see let's me at least think, that indeed all the nodes can
> connect to the "1st" node from which the job has been started as "all node
> programs connected", but seem not be able to reach each other, so stuck.
> This means that there's something weird with your network config and you
> might want to check that all the nodes can reach each other over the network
> you try to use, this may include possible firewall. This also still includes
> that the hostnames of all nodes resolve to outgoing ip addresses as
> explained before.
>
> Norman Geist.
>
>> -----Ursprüngliche Nachricht-----
>> Von: owner-namd-l_at_ks.uiuc.edu [mailto:owner-namd-l_at_ks.uiuc.edu] Im
>> Auftrag von Douglas Houston
>> Gesendet: Mittwoch, 18. Juni 2014 14:58
>> An: Norman Geist
>> Cc: Namd Mailing List
>> Betreff: Re: AW: AW: AW: namd-l: Using nodelist file causes namd to
>> hang
>>
>> itioc1 and 2 are in a different physical location to 3, 4 5 and 6, and
>> presumably this means they're on a different subnet. Does this mean
>> they can't be used?
>>
>> Quoting Norman Geist <norman.geist_at_uni-greifswald.de> on Wed, 18 Jun
>> 2014 14:52:29 +0200:
>>
>> > Look the line with the <----
>> >
>> >> >> Charmrun> adding client 0: "itioc3", IP:129.215.237.179
>> >> >> Charmrun> adding client 1: "itioc4", IP:129.215.237.180
>> >> >> Charmrun> adding client 2: "itioc5", IP:129.215.237.186
>> >> >> Charmrun> adding client 3: "itioc6", IP:129.215.237.187
>> >> >> Charmrun> adding client 4: "itioc1", IP:129.215.137.21 <-----
>> >> >> Charmrun> adding client 5: "itioc2", IP:129.215.137.123 <-----
>> >> >> Charmrun> adding client 6: "itioc3", IP:129.215.237.179
>> >> >> Charmrun> adding client 7: "itioc4", IP:129.215.237.180
>> >
>> > This nodes don't seem to use the same network as the other nodes!
>> > Something is definitely weird with your network config.
>> >
>> > Also:
>> >
>> >> 129.215.137.123 itioc2.bch.ed.ac.uk itioc2
>> >> 129.215.137.21 n3
>> >
>> > Is again different from what could be seen above. (137/237)
>> > This doesn't look continues and might be an error.
>> >
>> >
>> > Norman Geist.
>> >
>> >> -----Ursprüngliche Nachricht-----
>> >> Von: Douglas Houston [mailto:DouglasR.Houston_at_ed.ac.uk]
>> >> Gesendet: Mittwoch, 18. Juni 2014 14:24
>> >> An: Norman Geist
>> >> Cc: Namd Mailing List
>> >> Betreff: Re: AW: AW: namd-l: Using nodelist file causes namd to hang
>> >>
>> >> Here is an example of what /etc/hosts contains:
>> >>
>> >> # Do not remove the following line, or various programs
>> >> # that require network functionality will fail.
>> >> 127.0.0.1 localhost.localdomain localhost
>> >> 129.215.137.123 itioc2.bch.ed.ac.uk itioc2
>> >> ::1 localhost6.localdomain6 localhost6
>> >> 129.215.137.21 n3
>> >>
>> >> I'm not sure I can see anything wrong with it?
>> >>
>> >>
>> >>
>> >> Quoting Norman Geist <norman.geist_at_uni-greifswald.de> on Mon, 16 Jun
>> >> 2014 09:19:28 +0200:
>> >>
>> >> > This may be related to an unsuitable local dns setup. Please check
>> >> that in
>> >> > all the nodes "/etc/hosts" the hostname of the node does not point
>> to
>> >> a
>> >> > loopback address similar to 127.0.0.1 but too the outgoing IP.
>> I've
>> >> written
>> >> > another thread about that somewhen.
>> >> >
>> >> > Norman Geist.
>> >> >
>> >> >> -----Ursprüngliche Nachricht-----
>> >> >> Von: Douglas Houston [mailto:DouglasR.Houston_at_ed.ac.uk]
>> >> >> Gesendet: Freitag, 13. Juni 2014 19:17
>> >> >> An: Norman Geist
>> >> >> Cc: Namd Mailing List
>> >> >> Betreff: Re: AW: namd-l: Using nodelist file causes namd to hang
>> >> >>
>> >> >> Hi Norman,
>> >> >>
>> >> >> I have made some progress, I now get:
>> >> >>
>> >> >> [douglas_at_itioc1 200ns]$
>> >> >> /usr/people/douglas/programs/NAMD_2.9_Linux-x86/charmrun +p8
>> >> >> /usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2 ++verbose
>> >> >> mdrun.conf
>> >> >> Charmrun> charmrun started...
>> >> >> Charmrun> using ./nodelist as nodesfile
>> >> >> Charmrun> adding client 0: "itioc3", IP:129.215.237.179
>> >> >> Charmrun> adding client 1: "itioc4", IP:129.215.237.180
>> >> >> Charmrun> adding client 2: "itioc5", IP:129.215.237.186
>> >> >> Charmrun> adding client 3: "itioc6", IP:129.215.237.187
>> >> >> Charmrun> adding client 4: "itioc1", IP:129.215.137.21
>> >> >> Charmrun> adding client 5: "itioc2", IP:129.215.137.123
>> >> >> Charmrun> adding client 6: "itioc3", IP:129.215.237.179
>> >> >> Charmrun> adding client 7: "itioc4", IP:129.215.237.180
>> >> >> Charmrun> Charmrun = 129.215.137.21, port = 54043
>> >> >> start_nodes_rsh
>> >> >> Charmrun> Sending "0 129.215.137.21 54043 24199 0" to client 0.
>> >> >> Charmrun> find the node program
>> >> >> "/usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2" at
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/unfold_MD_Cks1pep
>> >> >> _par36_Skp2complex/200ns" for
>> >> >> 0.
>> >> >> Charmrun> Starting ssh itioc3 -l douglas /bin/sh -f
>> >> >> Charmrun> remote shell (itioc3:0) started
>> >> >> Charmrun> Sending "1 129.215.137.21 54043 24199 0" to client 1.
>> >> >> Charmrun> find the node program
>> >> >> "/usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2" at
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/unfold_MD_Cks1pep
>> >> >> _par36_Skp2complex/200ns" for
>> >> >> 1.
>> >> >> Charmrun> Starting ssh itioc4 -l douglas /bin/sh -f
>> >> >> Charmrun> remote shell (itioc4:1) started
>> >> >> Charmrun> Sending "2 129.215.137.21 54043 24199 0" to client 2.
>> >> >> Charmrun> find the node program
>> >> >> "/usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2" at
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/unfold_MD_Cks1pep
>> >> >> _par36_Skp2complex/200ns" for
>> >> >> 2.
>> >> >> Charmrun> Starting ssh itioc5 -l douglas /bin/sh -f
>> >> >> Charmrun> remote shell (itioc5:2) started
>> >> >> Charmrun> Sending "3 129.215.137.21 54043 24199 0" to client 3.
>> >> >> Charmrun> find the node program
>> >> >> "/usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2" at
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/unfold_MD_Cks1pep
>> >> >> _par36_Skp2complex/200ns" for
>> >> >> 3.
>> >> >> Charmrun> Starting ssh itioc6 -l douglas /bin/sh -f
>> >> >> Charmrun> remote shell (itioc6:3) started
>> >> >> Charmrun> Sending "4 129.215.137.21 54043 24199 0" to client 4.
>> >> >> Charmrun> find the node program
>> >> >> "/usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2" at
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/unfold_MD_Cks1pep
>> >> >> _par36_Skp2complex/200ns" for
>> >> >> 4.
>> >> >> Charmrun> Starting ssh itioc1 -l douglas /bin/sh -f
>> >> >> Charmrun> remote shell (itioc1:4) started
>> >> >> Charmrun> Sending "5 129.215.137.21 54043 24199 0" to client 5.
>> >> >> Charmrun> find the node program
>> >> >> "/usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2" at
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/unfold_MD_Cks1pep
>> >> >> _par36_Skp2complex/200ns" for
>> >> >> 5.
>> >> >> Charmrun> Starting ssh itioc2 -l douglas /bin/sh -f
>> >> >> Charmrun> remote shell (itioc2:5) started
>> >> >> Charmrun> Sending "6 129.215.137.21 54043 24199 0" to client 6.
>> >> >> Charmrun> find the node program
>> >> >> "/usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2" at
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/unfold_MD_Cks1pep
>> >> >> _par36_Skp2complex/200ns" for
>> >> >> 6.
>> >> >> Charmrun> Starting ssh itioc3 -l douglas /bin/sh -f
>> >> >> Charmrun> remote shell (itioc3:6) started
>> >> >> Charmrun> Sending "7 129.215.137.21 54043 24199 0" to client 7.
>> >> >> Charmrun> find the node program
>> >> >> "/usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2" at
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/unfold_MD_Cks1pep
>> >> >> _par36_Skp2complex/200ns" for
>> >> >> 7.
>> >> >> Charmrun> Starting ssh itioc4 -l douglas /bin/sh -f
>> >> >> Charmrun> remote shell (itioc4:7) started
>> >> >> Charmrun> node programs all started
>> >> >> Charmrun remote shell(itioc3.6)> remote responding...
>> >> >> Charmrun remote shell(itioc3.0)> remote responding...
>> >> >> Charmrun remote shell(itioc3.6)> starting node-program...
>> >> >> Charmrun remote shell(itioc3.0)> starting node-program...
>> >> >> Charmrun remote shell(itioc3.6)> rsh phase successful.
>> >> >> Charmrun remote shell(itioc3.0)> rsh phase successful.
>> >> >> Charmrun remote shell(itioc4.1)> remote responding...
>> >> >> Charmrun remote shell(itioc4.1)> starting node-program...
>> >> >> Charmrun remote shell(itioc4.1)> rsh phase successful.
>> >> >> Charmrun remote shell(itioc4.7)> remote responding...
>> >> >> Charmrun remote shell(itioc4.7)> starting node-program...
>> >> >> Charmrun remote shell(itioc4.7)> rsh phase successful.
>> >> >> Charmrun remote shell(itioc1.4)> remote responding...
>> >> >> Charmrun remote shell(itioc1.4)> starting node-program...
>> >> >> Charmrun remote shell(itioc1.4)> rsh phase successful.
>> >> >> Charmrun remote shell(itioc6.3)> remote responding...
>> >> >> Charmrun remote shell(itioc6.3)> starting node-program...
>> >> >> Charmrun remote shell(itioc6.3)> rsh phase successful.
>> >> >> Charmrun remote shell(itioc5.2)> remote responding...
>> >> >> Charmrun remote shell(itioc5.2)> starting node-program...
>> >> >> Charmrun remote shell(itioc5.2)> rsh phase successful.
>> >> >> Charmrun remote shell(itioc2.5)> remote responding...
>> >> >> Charmrun remote shell(itioc2.5)> starting node-program...
>> >> >> Charmrun remote shell(itioc2.5)> rsh phase successful.
>> >> >> Charmrun> Waiting for 0-th client to connect.
>> >> >> Charmrun> Waiting for 1-th client to connect.
>> >> >> Charmrun> Waiting for 2-th client to connect.
>> >> >> Charmrun> Waiting for 3-th client to connect.
>> >> >> Charmrun> Waiting for 4-th client to connect.
>> >> >> Charmrun> Waiting for 5-th client to connect.
>> >> >> Charmrun> client 0 connected (IP=129.215.237.179 data_port=45304)
>> >> >> Charmrun> client 6 connected (IP=129.215.237.179 data_port=54685)
>> >> >> Charmrun> client 4 connected (IP=129.215.137.21 data_port=49908)
>> >> >> Charmrun> client 5 connected (IP=129.215.137.123 data_port=40205)
>> >> >> Charmrun> client 1 connected (IP=129.215.237.180 data_port=47847)
>> >> >> Charmrun> client 7 connected (IP=129.215.237.180 data_port=45521)
>> >> >> Charmrun> Waiting for 6-th client to connect.
>> >> >> Charmrun> client 2 connected (IP=129.215.237.186 data_port=52855)
>> >> >> Charmrun> Waiting for 7-th client to connect.
>> >> >> Charmrun> client 3 connected (IP=129.215.237.187 data_port=50052)
>> >> >> Charmrun> All clients connected.
>> >> >> Charmrun> IP tables sent.
>> >> >> Charmrun> node programs all connected
>> >> >> Charmrun> started all node programs in 1.805 seconds.
>> >> >> Converse/Charm++ Commit ID: v6.4.0-beta1-0-g5776d21
>> >> >> Charm++> scheduler running in netpoll mode.
>> >> >> CharmLB> Load balancer assumes all CPUs are same.
>> >> >>
>> >> >>
>> >> >> Output to terminal halts at this point. All node processors are
>> >> >> running but nothing is written to disk. I see others have had
>> this
>> >> >> problem before:
>> >> >>
>> >> >> http://www.ks.uiuc.edu/Research/namd/mailing_list/namd-l.2011-
>> >> >> 2012/3776.html
>> >> >>
>> >> >> I tried your suggestion of running charmrun with the debug
>> option.
>> >> >> This causes 8 xterm windows to open, each with the following:
>> >> >>
>> >> >> GNU gdb (GDB) Fedora (7.2-16.fc14)
>> >> >> Copyright (C) 2010 Free Software Foundation, Inc.
>> >> >> License GPLv3+: GNU GPL version 3 or later
>> >> >> <http://gnu.org/licenses/gpl.html>
>> >> >> This is free software: you are free to change and redistribute
>> it.
>> >> >> There is NO WARRANTY, to the extent permitted by law. Type "show
>> >> >> copying"
>> >> >> and "show warranty" for details.
>> >> >> This GDB was configured as "x86_64-redhat-linux-gnu".
>> >> >> For bug reporting instructions, please see:
>> >> >> <http://www.gnu.org/software/gdb/bugs/>...
>> >> >> Reading symbols from
>> >> >> /usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2...(no
>> >> debugging
>> >> >> symbols found)...done.
>> >> >> (gdb)
>> >> >>
>> >> >>
>> >> >> What should I try next?
>> >> >>
>> >> >> cheers,
>> >> >> Doug
>> >> >>
>> >> >>
>> >> >> Quoting Norman Geist <norman.geist_at_uni-greifswald.de> on Mon, 2
>> Jun
>> >> >> 2014 13:31:08 +0200:
>> >> >>
>> >> >> > The error with "HOST IDENTIFICATION HAS CHANGED" means, that
>> the
>> >> >> entries in
>> >> >> > "known_hosts" are no more true. Therefore it would be easier to
>> >> >> delete ALL
>> >> >> > the "known_hosts" entries from all nodes and recreate them by
>> >> sshing
>> >> >> to each
>> >> >> > other and to localhost and 127.0.0.1. It might be easier if the
>> >> nodes
>> >> >> would
>> >> >> > share the same identification which can be done by mirroring
>> the
>> >> >> "~/.ssh"
>> >> >> > folder to all nodes after the clean-up
>> >> >> >
>> >> >> > Norman Geist.
>> >> >> >
>> >> >> >
>> >> >> >> -----Ursprüngliche Nachricht-----
>> >> >> >> Von: Douglas Houston [mailto:DouglasR.Houston_at_ed.ac.uk]
>> >> >> >> Gesendet: Montag, 2. Juni 2014 13:26
>> >> >> >> An: Norman Geist
>> >> >> >> Betreff: Re: AW: AW: AW: namd-l: Using nodelist file causes
>> namd
>> >> to
>> >> >> >> hang
>> >> >> >>
>> >> >> >> Hi Norman,
>> >> >> >>
>> >> >> >> My .ssh/known_hosts contains one line for each of the itioc
>> >> nodes,
>> >> >> >> plus one line for 127.0.0.1 and one line for localhost.
>> >> >> >>
>> >> >> >> Could you clarify which entries exactly I should delete in
>> this
>> >> >> file,
>> >> >> >> and also what you mean by "start over"?
>> >> >> >>
>> >> >> >> cheers,
>> >> >> >> Doug
>> >> >> >>
>> >> >> >>
>> >> >> >> Quoting Norman Geist <norman.geist_at_uni-greifswald.de> on Mon,
>> 2
>> >> Jun
>> >> >> >> 2014 13:06:30 +0200:
>> >> >> >>
>> >> >> >> > Easiest way is to delete all the nodes "known_hosts" entries
>> >> and
>> >> >> >> start over.
>> >> >> >> >
>> >> >> >> >
>> >> >> >> > Norman Geist.
>> >> >> >> >
>> >> >> >> >> -----Ursprüngliche Nachricht-----
>> >> >> >> >> Von: owner-namd-l_at_ks.uiuc.edu [mailto:owner-namd-
>> >> l_at_ks.uiuc.edu]
>> >> >> Im
>> >> >> >> >> Auftrag von Douglas Houston
>> >> >> >> >> Gesendet: Montag, 2. Juni 2014 11:51
>> >> >> >> >> An: Namd Mailing List
>> >> >> >> >> Betreff: Re: AW: AW: namd-l: Using nodelist file causes
>> namd
>> >> to
>> >> >> hang
>> >> >> >> >>
>> >> >> >> >> Sorry for the long delay but I ran out of time to continue
>> >> >> >> >> troubleshooting this, until now.
>> >> >> >> >>
>> >> >> >> >> To recap, I have 6 nodes. When I'm logged in to e.g. itioc6
>> I
>> >> can
>> >> >> >> ssh
>> >> >> >> >> to localhost, 127.0.0.1, and 129.215.237.187 (itioc6's IP
>> >> >> address).
>> >> >> >> >> But if I login to e.g. itioc1, I can't ssh to localhost
>> (see
>> >> >> error
>> >> >> >> >> message below). If I change the key in
>> >> ~douglas/.ssh/known_hosts
>> >> >> to
>> >> >> >> >> make this work on itioc1 it stops working on itioc6.
>> >> >> >> >>
>> >> >> >> >> It looks like I can only have one working "localhost" or
>> >> >> "127.0.0.1"
>> >> >> >> >> key in the known_hosts file, but as I understand it I need
>> all
>> >> my
>> >> >> >> >> itioc nodes to each have one. How can I achieve this?
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >> Quoting Norman Geist <norman.geist_at_uni-greifswald.de> on
>> Wed,
>> >> 9
>> >> >> Apr
>> >> >> >> >> 2014 12:53:50 +0200:
>> >> >> >> >>
>> >> >> >> >> > This may be a hint. Your nodes must not only be able to
>> >> logon
>> >> >> to
>> >> >> >> all
>> >> >> >> >> nodes
>> >> >> >> >> > without password, but should also be able to logon to
>> >> >> themselves
>> >> >> >> via
>> >> >> >> >> own IP
>> >> >> >> >> > address, localhost and 127.0.0.1
>> >> >> >> >> >
>> >> >> >> >> > You may want to delete the wrong entries in
>> >> ~/.ssh/known_hosts
>> >> >> on
>> >> >> >> the
>> >> >> >> >> nodes,
>> >> >> >> >> > and recreate by ssh to the targets mentioned above.
>> >> >> >> >> >
>> >> >> >> >> > Norman Geist.
>> >> >> >> >> >
>> >> >> >> >> >
>> >> >> >> >> >> -----Ursprüngliche Nachricht-----
>> >> >> >> >> >> Von: Douglas Houston [mailto:DouglasR.Houston_at_ed.ac.uk]
>> >> >> >> >> >> Gesendet: Mittwoch, 9. April 2014 12:42
>> >> >> >> >> >> An: Norman Geist
>> >> >> >> >> >> Betreff: Re: AW: namd-l: Using nodelist file causes namd
>> to
>> >> >> hang
>> >> >> >> >> >>
>> >> >> >> >> >> The same command without the ++local causes the nodelist
>> >> file
>> >> >> to
>> >> >> >> be
>> >> >> >> >> >> used, I have already posed the output from this.
>> >> >> >> >> >>
>> >> >> >> >> >> If I delete the nodelist file, the same command without
>> the
>> >> >> >> ++local
>> >> >> >> >> >> (which causes the file /usr/people/douglas/.nodelist to
>> be
>> >> >> used)
>> >> >> >> >> >> outputs:
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >> Charmrun> charmrun started...
>> >> >> >> >> >> Charmrun> using /usr/people/douglas/.nodelist as
>> nodesfile
>> >> >> >> >> >> Charmrun> adding client 0: "localhost", IP:127.0.0.1
>> >> >> >> >> >> Charmrun> Charmrun = 129.215.237.187, port = 35909
>> >> >> >> >> >> start_nodes_rsh
>> >> >> >> >> >> Charmrun> Sending "0 129.215.237.187 35909 27843 0" to
>> >> client
>> >> >> 0.
>> >> >> >> >> >> Charmrun> find the node program
>> >> >> >> >> >> "/usr/people/douglas/programs/NAMD_2.9_Linux-x86/namd2"
>> at
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> " for
>> >> >> >> >> >> 0.
>> >> >> >> >> >> Charmrun> Starting ssh localhost -l douglas /bin/sh -f
>> >> >> >> >> >> Charmrun> remote shell (localhost:0) started
>> >> >> >> >> >> Charmrun> node programs all started
>> >> >> >> >> >>
>> @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
>> >> >> >> >> >> @ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!
>> @
>> >> >> >> >> >>
>> @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
>> >> >> >> >> >> IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
>> >> >> >> >> >> Someone could be eavesdropping on you right now (man-in-
>> >> the-
>> >> >> >> middle
>> >> >> >> >> >> attack)!
>> >> >> >> >> >> It is also possible that the RSA host key has just been
>> >> >> changed.
>> >> >> >> >> >> The fingerprint for the RSA key sent by the remote host
>> is
>> >> >> >> >> >> 99:cb:e0:0a:77:8b:61:fd:19:01:57:93:ec:93:99:63.
>> >> >> >> >> >> Please contact your system administrator.
>> >> >> >> >> >> Add correct host key in
>> >> /usr/people/douglas/.ssh/known_hosts
>> >> >> to
>> >> >> >> get
>> >> >> >> >> >> rid of this message.
>> >> >> >> >> >> Offending key in /usr/people/douglas/.ssh/known_hosts:47
>> >> >> >> >> >> RSA host key for localhost has changed and you have
>> >> requested
>> >> >> >> strict
>> >> >> >> >> >> checking.
>> >> >> >> >> >> Host key verification failed.
>> >> >> >> >> >> Charmrun> Error 255 returned from rsh (localhost:0)
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >> The file /usr/people/douglas/.nodelist contains:
>> >> >> >> >> >> group main
>> >> >> >> >> >> host localhost
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >> Quoting Norman Geist <norman.geist_at_uni-greifswald.de> on
>> >> Wed,
>> >> >> 9
>> >> >> >> Apr
>> >> >> >> >> >> 2014 12:28:51 +0200:
>> >> >> >> >> >>
>> >> >> >> >> >> > Please try the same command without ++local and see if
>> it
>> >> >> still
>> >> >> >> >> >> works.
>> >> >> >> >> >> >
>> >> >> >> >> >> >> -----Ursprüngliche Nachricht-----
>> >> >> >> >> >> >> Von: owner-namd-l_at_ks.uiuc.edu [mailto:owner-namd-
>> >> >> >> l_at_ks.uiuc.edu]
>> >> >> >> >> Im
>> >> >> >> >> >> >> Auftrag von Douglas Houston
>> >> >> >> >> >> >> Gesendet: Mittwoch, 9. April 2014 11:49
>> >> >> >> >> >> >> An: ramya narasimhan
>> >> >> >> >> >> >> Cc: Namd Mailing List
>> >> >> >> >> >> >> Betreff: Re: namd-l: Using nodelist file causes namd
>> to
>> >> >> hang
>> >> >> >> >> >> >>
>> >> >> >> >> >> >> The result is the same whichever order the nodes are
>> >> >> present
>> >> >> >> in
>> >> >> >> >> the
>> >> >> >> >> >> >> list.
>> >> >> >> >> >> >>
>> >> >> >> >> >> >> What exactly is Charmrun waiting for at the "Waiting
>> for
>> >> 0-
>> >> >> th
>> >> >> >> >> client
>> >> >> >> >> >> >> to connect." stage? Presumably the 0th client is the
>> >> first
>> >> >> in
>> >> >> >> >> >> >> nodelist, and that a process is supposed to start on
>> >> that
>> >> >> >> node,
>> >> >> >> >> then
>> >> >> >> >> >> >> "connect" to Charmrun on the host machine?
>> >> >> >> >> >> >
>> >> >> >> >> >> > Charmrun is just spawning the namd processes and now
>> is
>> >> >> waiting
>> >> >> >> >> for
>> >> >> >> >> >> them to
>> >> >> >> >> >> > start to talk.
>> >> >> >> >> >> >
>> >> >> >> >> >> >>
>> >> >> >> >> >> >> Using the command top I see no evidence of anything
>> new
>> >> >> >> starting
>> >> >> >> >> on
>> >> >> >> >> >> >> the node, despite all the "starting node-program" and
>> >> "rsh
>> >> >> >> phase
>> >> >> >> >> >> >> successful" messages that are output.
>> >> >> >> >> >> >>
>> >> >> >> >> >> >> Using "ps -u douglas" on the node shows a whole bunch
>> of
>> >> >> tcsh
>> >> >> >> and
>> >> >> >> >> sh
>> >> >> >> >> >> >> shells and sleep processes starting then dying but
>> >> nothing
>> >> >> >> else.
>> >> >> >> >> >> >>
>> >> >> >> >> >> >> What does the line "Sending "0 129.215.237.187 57453
>> >> 26737
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> >> client 0" mean? How is this "sending" achieved? I see
>> >> "port
>> >> >> >> >> 57453"
>> >> >> >> >> >> is
>> >> >> >> >> >> >> mentioned in the output ...
>> >> >> >> >> >> >
>> >> >> >> >> >> > Seems like being part of the parallel startup, where
>> the
>> >> >> >> spawned
>> >> >> >> >> >> processes
>> >> >> >> >> >> > get the information about each other.
>> >> >> >> >> >> >
>> >> >> >> >> >> >>
>> >> >> >> >> >> >>
>> >> >> >> >> >> >>
>> >> >> >> >> >> >>
>> >> >> >> >> >> >> Quoting ramya narasimhan <ramya_jln_at_yahoo.co.in> on
>> Wed,
>> >> 9
>> >> >> Apr
>> >> >> >> >> 2014
>> >> >> >> >> >> >> 11:51:52 +0800 (SGT):
>> >> >> >> >> >> >>
>> >> >> >> >> >> >> > Just change the hostname [IP of the system] order
>> in
>> >> the
>> >> >> >> >> >> >> > nodefile, so that the 0-th client will be itioc5
>> >> instead
>> >> >> >> >> >> of itioc1.
>> >> >> >> >> >> >> > To find whether the problem is with nodes.
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> > Dr. Ramya.L.
>> >> >> >> >> >> >> > On Tuesday, 8 April 2014 7:23 PM, Douglas Houston
>> >> >> >> >> >> >> > <DouglasR.Houston_at_ed.ac.uk> wrote:
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> > Yes, with ping all the nodes resolve to full
>> hostnames
>> >> >> and
>> >> >> >> IP
>> >> >> >> >> >> >> > addresses. I tried putting IP addresses into
>> nodelist
>> >> >> >> instead
>> >> >> >> >> of
>> >> >> >> >> >> >> > hostnames but it still times out at "Waiting for 0-
>> th
>> >> >> client
>> >> >> >> to
>> >> >> >> >> >> >> connect"
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> > Quoting Norman Geist <norman.geist_at_uni-
>> greifswald.de>
>> >> on
>> >> >> >> Tue, 8
>> >> >> >> >> >> Apr
>> >> >> >> >> >> >> > 2014 14:30:15 +0200:
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> >> On all the nodes? Otherwise try a nodelist with IP
>> >> >> adresses
>> >> >> >> >> >> instead
>> >> >> >> >> >> >> of
>> >> >> >> >> >> >> >> hostnames. If that works, you got a problem with
>> >> local
>> >> >> DNS.
>> >> >> >> >> >> >> >>
>> >> >> >> >> >> >> >> Norman Geist.
>> >> >> >> >> >> >> >>
>> >> >> >> >> >> >> >>
>> >> >> >> >> >> >> >>> -----Ursprüngliche Nachricht-----
>> >> >> >> >> >> >> >>> Von: Douglas Houston
>> >> [mailto:DouglasR.Houston_at_ed.ac.uk]
>> >> >> >> >> >> >> >>> Gesendet: Dienstag, 8. April 2014 14:14
>> >> >> >> >> >> >> >>> An: Norman Geist
>> >> >> >> >> >> >> >>> Cc: Namd Mailing List
>> >> >> >> >> >> >> >>> Betreff: Re: AW: AW: namd-l: Using nodelist file
>> >> causes
>> >> >> >> namd
>> >> >> >> >> to
>> >> >> >> >> >> >> hang
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>> Thanks Norman. I had found that thread after my
>> >> >> searches
>> >> >> >> but
>> >> >> >> >> it
>> >> >> >> >> >> did
>> >> >> >> >> >> >> >>> not seem to apply to my problem.
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>> "You can check this while doing a ping to the
>> >> hostname,
>> >> >> >> while
>> >> >> >> >> >> you
>> >> >> >> >> >> >> are
>> >> >> >> >> >> >> >>> logged in at a compute node "ping hostname". If
>> this
>> >> >> >> returns
>> >> >> >> >> an
>> >> >> >> >> >> >> >>> 127.x.x.x address, your local DNS configuration
>> is
>> >> not
>> >> >> >> >> suitable
>> >> >> >> >> >> for
>> >> >> >> >> >> >> >>> charmrun"
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>> My ping returns the full name and IP address of
>> the
>> >> >> node,
>> >> >> >> not
>> >> >> >> >> >> >> >>> 127.x.x.x.
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>> Quoting Norman Geist <norman.geist_at_uni-
>> >> greifswald.de>
>> >> >> on
>> >> >> >> Tue,
>> >> >> >> >> 8
>> >> >> >> >> >> Apr
>> >> >> >> >> >> >> >>> 2014 13:22:41 +0200:
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>> > Now I remember that I already posted a solution
>> >> for
>> >> >> this
>> >> >> >> >> some
>> >> >> >> >> >> >> weeks
>> >> >> >> >> >> >> >>> ago, you
>> >> >> >> >> >> >> >>> > could have found it by using google.de. Maybe
>> this
>> >> >> helps
>> >> >> >> >> you.
>> >> >> >> >> >> >> >>> >
>> >> >> >> >> >> >> >>> >
>> >> >> http://www.ks.uiuc.edu/Research/namd/mailing_list/namd-
>> >> >> >> >> l.2012-
>> >> >> >> >> >> >> >>> 2013/2645.html
>> >> >> >> >> >> >> >>> >
>> >> >> >> >> >> >> >>> > Norman Geist.
>> >> >> >> >> >> >> >>> >
>> >> >> >> >> >> >> >>> >
>> >> >> >> >> >> >> >>> >> -----Ursprüngliche Nachricht-----
>> >> >> >> >> >> >> >>> >> Von: owner-namd-l_at_ks.uiuc.edu [mailto:owner-
>> namd-
>> >> >> >> >> >> l_at_ks.uiuc.edu]
>> >> >> >> >> >> >> Im
>> >> >> >> >> >> >> >>> >> Auftrag von Douglas Houston
>> >> >> >> >> >> >> >>> >> Gesendet: Dienstag, 8. April 2014 12:53
>> >> >> >> >> >> >> >>> >> An: Norman Geist
>> >> >> >> >> >> >> >>> >> Cc: Namd Mailing List
>> >> >> >> >> >> >> >>> >> Betreff: Re: AW: namd-l: Using nodelist file
>> >> causes
>> >> >> >> namd
>> >> >> >> >> to
>> >> >> >> >> >> hang
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >> Thanks for the tip Norman, but if I change my
>> >> >> command
>> >> >> >> to
>> >> >> >> >> the
>> >> >> >> >> >> >> >>> following
>> >> >> >> >> >> >> >>> >> it still hangs at the same point:
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >> /usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/charmrun
>> >> >> >> >> +p12
>> >> >> >> >> >> >> >>> >> ++remote-shell ssh
>> >> >> >> >> >> >> >>> >> /usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> x86/namd2
>> >> >> >> >> >> ++verbose
>> >> >> >> >> >> >> >>> >> mdrun.conf
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >> Quoting Norman Geist <norman.geist_at_uni-
>> >> >> greifswald.de>
>> >> >> >> on
>> >> >> >> >> Tue,
>> >> >> >> >> >> 8
>> >> >> >> >> >> >> Apr
>> >> >> >> >> >> >> >>> >> 2014 12:06:03 +0200:
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >> > Try the charmrun option "++remote-shell
>> ssh".
>> >> >> >> >> >> >> >>> >> >
>> >> >> >> >> >> >> >>> >> > Norman Geist.
>> >> >> >> >> >> >> >>> >> >
>> >> >> >> >> >> >> >>> >> >> -----Ursprüngliche Nachricht-----
>> >> >> >> >> >> >> >>> >> >> Von: owner-namd-l_at_ks.uiuc.edu
>> [mailto:owner-
>> >> namd-
>> >> >> >> >> >> >> l_at_ks.uiuc.edu]
>> >> >> >> >> >> >> >>> Im
>> >> >> >> >> >> >> >>> >> >> Auftrag von Douglas Houston
>> >> >> >> >> >> >> >>> >> >> Gesendet: Dienstag, 8. April 2014 11:30
>> >> >> >> >> >> >> >>> >> >> An: namd-l_at_ks.uiuc.edu
>> >> >> >> >> >> >> >>> >> >> Betreff: namd-l: Using nodelist file causes
>> >> namd
>> >> >> to
>> >> >> >> >> hang
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> I have two nodes connected via ethernet:
>> >> itioc5
>> >> >> and
>> >> >> >> >> itioc1
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> I have the following in my nodelist file:
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> group main
>> >> >> >> >> >> >> >>> >> >> host itioc1
>> >> >> >> >> >> >> >>> >> >> host itioc5
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> I am using the following command:
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >>
>> /usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> >> x86/charmrun
>> >> >> >> >> >> +p12
>> >> >> >> >> >> >> >>> >> >>
>> /usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2
>> >> >> >> >> >> >> ++verbose
>> >> >> >> >> >> >> >>> >> >> mdrun.conf
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> I get the following output:
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> Charmrun> charmrun started...
>> >> >> >> >> >> >> >>> >> >> Charmrun> using ./nodelist as nodesfile
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 0: "itioc1",
>> >> >> >> IP:129.215.137.21
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 1: "itioc5",
>> >> >> >> IP:129.215.237.186
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 2: "itioc1",
>> >> >> >> IP:129.215.137.21
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 3: "itioc5",
>> >> >> >> IP:129.215.237.186
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 4: "itioc1",
>> >> >> >> IP:129.215.137.21
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 5: "itioc5",
>> >> >> >> IP:129.215.237.186
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 6: "itioc1",
>> >> >> >> IP:129.215.137.21
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 7: "itioc5",
>> >> >> >> IP:129.215.237.186
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 8: "itioc1",
>> >> >> >> IP:129.215.137.21
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 9: "itioc5",
>> >> >> >> IP:129.215.237.186
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 10: "itioc1",
>> >> >> >> IP:129.215.137.21
>> >> >> >> >> >> >> >>> >> >> Charmrun> adding client 11: "itioc5",
>> >> >> >> >> IP:129.215.237.186
>> >> >> >> >> >> >> >>> >> >> Charmrun> Charmrun = 129.215.237.187, port
>> =
>> >> >> 58330
>> >> >> >> >> >> >> >>> >> >> start_nodes_rsh
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "0 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> client
>> >> >> >> >> >> >> 0.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 0.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc1 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc1:0) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "1 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> client
>> >> >> >> >> >> >> 1.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 1.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc5 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc5:1) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "2 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> client
>> >> >> >> >> >> >> 2.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 2.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc1 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc1:2) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "3 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> client
>> >> >> >> >> >> >> 3.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 3.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc5 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc5:3) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "4 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> client
>> >> >> >> >> >> >> 4.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 4.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc1 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc1:4) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "5 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> client
>> >> >> >> >> >> >> 5.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 5.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc5 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc5:5) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "6 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> client
>> >> >> >> >> >> >> 6.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 6.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc1 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc1:6) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "7 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> client
>> >> >> >> >> >> >> 7.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 7.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc5 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc5:7) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "8 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> client
>> >> >> >> >> >> >> 8.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 8.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc1 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc1:8) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "9 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> client
>> >> >> >> >> >> >> 9.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 9.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc5 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc5:9) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "10 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> >> client
>> >> >> >> >> >> >> >>> 10.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 10.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc1 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc1:10) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> Sending "11 129.215.237.187 58330
>> >> 19205
>> >> >> 0"
>> >> >> >> to
>> >> >> >> >> >> >> client
>> >> >> >> >> >> >> >>> 11.
>> >> >> >> >> >> >> >>> >> >> Charmrun> find the node program
>> >> >> >> >> >> >> >>> >> >>
>> "/usr/people/douglas/programs/NAMD_2.9_Linux-
>> >> >> >> x86/namd2"
>> >> >> >> >> at
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >>
>> >>
>> "/usr/people/douglas/projects/UPS/targets/SCF/2AST/MD/parallelise_itioc
>> >> >> >> >> >> >> >>> >> >> " for
>> >> >> >> >> >> >> >>> >> >> 11.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Starting ssh itioc5 -l douglas
>> >> /bin/sh
>> >> >> -f
>> >> >> >> >> >> >> >>> >> >> Charmrun> remote shell (itioc5:11) started
>> >> >> >> >> >> >> >>> >> >> Charmrun> node programs all started
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.3)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.5)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.3)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.5)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.3)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.5)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.9)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.7)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.11)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.1)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.9)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.7)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.9)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.7)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.11)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.1)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.11)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc5.1)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.10)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.0)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.4)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.10)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.10)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.0)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.0)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.4)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.4)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.2)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.6)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.8)> remote
>> >> >> >> responding...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.2)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.2)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.6)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.6)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.8)> starting
>> >> node-
>> >> >> >> >> program...
>> >> >> >> >> >> >> >>> >> >> Charmrun remote shell(itioc1.8)> rsh phase
>> >> >> >> successful.
>> >> >> >> >> >> >> >>> >> >> Charmrun> Waiting for 0-th client to
>> connect.
>> >> >> >> >> >> >> >>> >> >> Charmrun> error 0 attaching to node:
>> >> >> >> >> >> >> >>> >> >> Timeout waiting for node-program to connect
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> I'm not sure but I think the "Starting ssh
>> >> itioc5
>> >> >> -l
>> >> >> >> >> >> douglas
>> >> >> >> >> >> >> >>> /bin/sh
>> >> >> >> >> >> >> >>> >> >> -f" lines has something to do with it. If I
>> >> run
>> >> >> the
>> >> >> >> >> >> command
>> >> >> >> >> >> >> "ssh
>> >> >> >> >> >> >> >>> >> >> itioc5 -l douglas /bin/sh -f" it also
>> hangs.
>> >> If I
>> >> >> >> run
>> >> >> >> >> "ssh
>> >> >> >> >> >> >> itioc5
>> >> >> >> >> >> >> >>> -l
>> >> >> >> >> >> >> >>> >> >> douglas" then it logs me in just fine
>> (without
>> >> >> >> asking
>> >> >> >> >> for
>> >> >> >> >> >> a
>> >> >> >> >> >> >> >>> >> password).
>> >> >> >> >> >> >> >>> >> >> Similarly the command "ssh itioc5 -l
>> douglas -
>> >> f
>> >> >> pwd"
>> >> >> >> >> works
>> >> >> >> >> >> >> fine,
>> >> >> >> >> >> >> >>> >> with
>> >> >> >> >> >> >> >>> >> >> the expected directory name returned.
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> What exactly is happening at the "Waiting
>> for
>> >> 0-
>> >> >> th
>> >> >> >> >> client
>> >> >> >> >> >> to
>> >> >> >> >> >> >> >>> >> connect."
>> >> >> >> >> >> >> >>> >> >> stage?
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> Many thanks in advance for your thoughts.
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> cheers,
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> Doug
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> _____________________________________________________
>> >> >> >> >> >> >> >>> >> >> Dr. Douglas R. Houston
>> >> >> >> >> >> >> >>> >> >> Lecturer
>> >> >> >> >> >> >> >>> >> >> Institute of Structural and Molecular
>> Biology
>> >> >> >> >> >> >> >>> >> >> Room 3.23, Michael Swann Building
>> >> >> >> >> >> >> >>> >> >> King's Buildings
>> >> >> >> >> >> >> >>> >> >> University of Edinburgh
>> >> >> >> >> >> >> >>> >> >> Edinburgh, EH9 3JR, UK
>> >> >> >> >> >> >> >>> >> >> Tel. 0131 650 7358
>> >> >> >> >> >> >> >>> >> >> http://tinyurl.com/douglasrhouston
>> >> >> >> >> >> >> >>> >> >>
>> >> >> >> >> >> >> >>> >> >> --
>> >> >> >> >> >> >> >>> >> >> The University of Edinburgh is a charitable
>> >> body,
>> >> >> >> >> >> registered
>> >> >> >> >> >> >> in
>> >> >> >> >> >> >> >>> >> >> Scotland, with registration number
>> SC005336.
>> >> >> >> >> >> >> >>> >> >
>> >> >> >> >> >> >> >>> >> >
>> >> >> >> >> >> >> >>> >> >
>> >> >> >> >> >> >> >>> >> > ---
>> >> >> >> >> >> >> >>> >> > Diese E-Mail ist frei von Viren und Malware,
>> >> denn
>> >> >> der
>> >> >> >> >> >> avast!
>> >> >> >> >> >> >> >>> >> > Antivirus Schutz ist aktiv.
>> >> >> >> >> >> >> >>> >> > http://www.avast.com
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> >>> >> >
>> >> >> >> >> >> >> >>> >> >
>> >> >> >> >> >> >> >>> >> >
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >>
>> >> >> _____________________________________________________
>> >> >> >> >> >> >> >>> >> Dr. Douglas R. Houston
>> >> >> >> >> >> >> >>> >> Lecturer
>> >> >> >> >> >> >> >>> >> Institute of Structural and Molecular Biology
>> >> >> >> >> >> >> >>> >> Room 3.23, Michael Swann Building
>> >> >> >> >> >> >> >>> >> King's Buildings
>> >> >> >> >> >> >> >>> >> University of Edinburgh
>> >> >> >> >> >> >> >>> >> Edinburgh, EH9 3JR, UK
>> >> >> >> >> >> >> >>> >> Tel. 0131 650 7358
>> >> >> >> >> >> >> >>> >> http://tinyurl.com/douglasrhouston
>> >> >> >> >> >> >> >>> >>
>> >> >> >> >> >> >> >>> >> --
>> >> >> >> >> >> >> >>> >> The University of Edinburgh is a charitable
>> body,
>> >> >> >> >> registered
>> >> >> >> >> >> in
>> >> >> >> >> >> >> >>> >> Scotland, with registration number SC005336.
>> >> >> >> >> >> >> >>> >
>> >> >> >> >> >> >> >>> >
>> >> >> >> >> >> >> >>> >
>> >> >> >> >> >> >> >>> > ---
>> >> >> >> >> >> >> >>> > Diese E-Mail ist frei von Viren und Malware,
>> denn
>> >> der
>> >> >> >> >> avast!
>> >> >> >> >> >> >> >>> > Antivirus Schutz ist aktiv.
>> >> >> >> >> >> >> >>> > http://www.avast.com
>> >> >> >> >> >> >> >>> >
>> >> >> >> >> >> >> >>> >
>> >> >> >> >> >> >> >>> >
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>>
>> >> _____________________________________________________
>> >> >> >> >> >> >> >>> Dr. Douglas R. Houston
>> >> >> >> >> >> >> >>> Lecturer
>> >> >> >> >> >> >> >>> Institute of Structural and Molecular Biology
>> >> >> >> >> >> >> >>> Room 3.23, Michael Swann Building
>> >> >> >> >> >> >> >>> King's Buildings
>> >> >> >> >> >> >> >>> University of Edinburgh
>> >> >> >> >> >> >> >>> Edinburgh, EH9 3JR, UK
>> >> >> >> >> >> >> >>> Tel. 0131 650 7358
>> >> >> >> >> >> >> >>> http://tinyurl.com/douglasrhouston
>> >> >> >> >> >> >> >>>
>> >> >> >> >> >> >> >>> --
>> >> >> >> >> >> >> >>> The University of Edinburgh is a charitable body,
>> >> >> >> registered
>> >> >> >> >> in
>> >> >> >> >> >> >> >>> Scotland, with registration number SC005336.
>> >> >> >> >> >> >> >>
>> >> >> >> >> >> >> >>
>> >> >> >> >> >> >> >>
>> >> >> >> >> >> >> >> ---
>> >> >> >> >> >> >> >> Diese E-Mail ist frei von Viren und Malware, denn
>> der
>> >> >> >> avast!
>> >> >> >> >> >> >> >> Antivirus Schutz ist aktiv.
>> >> >> >> >> >> >> >> http://www.avast.com
>> >> >> >> >> >> >> >>
>> >> >> >> >> >> >> >>
>> >> >> >> >> >> >> >>
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> >
>> _____________________________________________________
>> >> >> >> >> >> >> > Dr. Douglas R. Houston
>> >> >> >> >> >> >> > Lecturer
>> >> >> >> >> >> >> > Institute of Structural and Molecular Biology
>> >> >> >> >> >> >> > Room 3.23, Michael Swann Building
>> >> >> >> >> >> >> > King's Buildings
>> >> >> >> >> >> >> > University of Edinburgh
>> >> >> >> >> >> >> > Edinburgh, EH9 3JR, UK
>> >> >> >> >> >> >> > Tel. 0131 650 7358
>> >> >> >> >> >> >> > http://tinyurl.com/douglasrhouston
>> >> >> >> >> >> >> >
>> >> >> >> >> >> >> > --
>> >> >> >> >> >> >> > The University of Edinburgh is a charitable body,
>> >> >> registered
>> >> >> >> in
>> >> >> >> >> >> >> > Scotland, with registration number SC005336.
>> >> >> >> >> >> >>
>> >> >> >> >> >> >>
>> >> >> >> >> >> >>
>> >> >> >> >> >> >>
>> >> >> >> >> >> >> _____________________________________________________
>> >> >> >> >> >> >> Dr. Douglas R. Houston
>> >> >> >> >> >> >> Lecturer
>> >> >> >> >> >> >> Institute of Structural and Molecular Biology
>> >> >> >> >> >> >> Room 3.23, Michael Swann Building
>> >> >> >> >> >> >> King's Buildings
>> >> >> >> >> >> >> University of Edinburgh
>> >> >> >> >> >> >> Edinburgh, EH9 3JR, UK
>> >> >> >> >> >> >> Tel. 0131 650 7358
>> >> >> >> >> >> >> http://tinyurl.com/douglasrhouston
>> >> >> >> >> >> >>
>> >> >> >> >> >> >> --
>> >> >> >> >> >> >> The University of Edinburgh is a charitable body,
>> >> >> registered
>> >> >> >> in
>> >> >> >> >> >> >> Scotland, with registration number SC005336.
>> >> >> >> >> >> >
>> >> >> >> >> >> >
>> >> >> >> >> >> >
>> >> >> >> >> >> > ---
>> >> >> >> >> >> > Diese E-Mail ist frei von Viren und Malware, denn der
>> >> avast!
>> >> >> >> >> >> > Antivirus Schutz ist aktiv.
>> >> >> >> >> >> > http://www.avast.com
>> >> >> >> >> >> >
>> >> >> >> >> >> >
>> >> >> >> >> >> >
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >> _____________________________________________________
>> >> >> >> >> >> Dr. Douglas R. Houston
>> >> >> >> >> >> Lecturer
>> >> >> >> >> >> Institute of Structural and Molecular Biology
>> >> >> >> >> >> Room 3.23, Michael Swann Building
>> >> >> >> >> >> King's Buildings
>> >> >> >> >> >> University of Edinburgh
>> >> >> >> >> >> Edinburgh, EH9 3JR, UK
>> >> >> >> >> >> Tel. 0131 650 7358
>> >> >> >> >> >> http://tinyurl.com/douglasrhouston
>> >> >> >> >> >>
>> >> >> >> >> >> --
>> >> >> >> >> >> The University of Edinburgh is a charitable body,
>> >> registered
>> >> >> in
>> >> >> >> >> >> Scotland, with registration number SC005336.
>> >> >> >> >> >
>> >> >> >> >> >
>> >> >> >> >> >
>> >> >> >> >> > ---
>> >> >> >> >> > Diese E-Mail ist frei von Viren und Malware, denn der
>> avast!
>> >> >> >> >> > Antivirus Schutz ist aktiv.
>> >> >> >> >> > http://www.avast.com
>> >> >> >> >> >
>> >> >> >> >> >
>> >> >> >> >> >
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >> _____________________________________________________
>> >> >> >> >> Dr. Douglas R. Houston
>> >> >> >> >> Lecturer
>> >> >> >> >> Institute of Structural and Molecular Biology
>> >> >> >> >> Room 3.23, Michael Swann Building
>> >> >> >> >> King's Buildings
>> >> >> >> >> University of Edinburgh
>> >> >> >> >> Edinburgh, EH9 3JR, UK
>> >> >> >> >> Tel. 0131 650 7358
>> >> >> >> >> http://tinyurl.com/douglasrhouston
>> >> >> >> >>
>> >> >> >> >> --
>> >> >> >> >> The University of Edinburgh is a charitable body,
>> registered
>> >> in
>> >> >> >> >> Scotland, with registration number SC005336.
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >
>> >> >> >> > ---
>> >> >> >> > Diese E-Mail ist frei von Viren und Malware, denn der avast!
>> >> >> >> > Antivirus Schutz ist aktiv.
>> >> >> >> > http://www.avast.com
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >> _____________________________________________________
>> >> >> >> Dr. Douglas R. Houston
>> >> >> >> Lecturer
>> >> >> >> Institute of Structural and Molecular Biology
>> >> >> >> Room 3.23, Michael Swann Building
>> >> >> >> King's Buildings
>> >> >> >> University of Edinburgh
>> >> >> >> Edinburgh, EH9 3JR, UK
>> >> >> >> Tel. 0131 650 7358
>> >> >> >> http://tinyurl.com/douglasrhouston
>> >> >> >>
>> >> >> >> --
>> >> >> >> The University of Edinburgh is a charitable body, registered
>> in
>> >> >> >> Scotland, with registration number SC005336.
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> > ---
>> >> >> > Diese E-Mail ist frei von Viren und Malware, denn der avast!
>> >> >> > Antivirus Schutz ist aktiv.
>> >> >> > http://www.avast.com
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >>
>> >> >>
>> >> >>
>> >> >>
>> >> >> _____________________________________________________
>> >> >> Dr. Douglas R. Houston
>> >> >> Lecturer
>> >> >> Institute of Structural and Molecular Biology
>> >> >> Room 3.23, Michael Swann Building
>> >> >> King's Buildings
>> >> >> University of Edinburgh
>> >> >> Edinburgh, EH9 3JR, UK
>> >> >> Tel. 0131 650 7358
>> >> >> http://tinyurl.com/douglasrhouston
>> >> >>
>> >> >> --
>> >> >> The University of Edinburgh is a charitable body, registered in
>> >> >> Scotland, with registration number SC005336.
>> >> >>
>> >> >
>> >> >
>> >> >
>> >> > ---
>> >> > Diese E-Mail ist frei von Viren und Malware, denn der avast!
>> >> > Antivirus Schutz ist aktiv.
>> >> > http://www.avast.com
>> >> >
>> >> >
>> >> >
>> >> >
>> >>
>> >>
>> >>
>> >>
>> >> _____________________________________________________
>> >> Dr. Douglas R. Houston
>> >> Lecturer
>> >> Institute of Structural and Molecular Biology
>> >> Room 3.23, Michael Swann Building
>> >> King's Buildings
>> >> University of Edinburgh
>> >> Edinburgh, EH9 3JR, UK
>> >> Tel. 0131 650 7358
>> >> http://tinyurl.com/douglasrhouston
>> >>
>> >> --
>> >> The University of Edinburgh is a charitable body, registered in
>> >> Scotland, with registration number SC005336.
>> >>
>> >
>> >
>> >
>> > ---
>> > Diese E-Mail ist frei von Viren und Malware, denn der avast!
>> > Antivirus Schutz ist aktiv.
>> > http://www.avast.com
>> >
>> >
>> >
>> >
>>
>>
>>
>>
>> _____________________________________________________
>> Dr. Douglas R. Houston
>> Lecturer
>> Institute of Structural and Molecular Biology
>> Room 3.23, Michael Swann Building
>> King's Buildings
>> University of Edinburgh
>> Edinburgh, EH9 3JR, UK
>> Tel. 0131 650 7358
>> http://tinyurl.com/douglasrhouston
>>
>> --
>> The University of Edinburgh is a charitable body, registered in
>> Scotland, with registration number SC005336.
>
>
> ---
> Diese E-Mail ist frei von Viren und Malware, denn der avast!
> Antivirus Schutz ist aktiv.
> http://www.avast.com
>
>
>

_____________________________________________________
Dr. Douglas R. Houston
Lecturer
Institute of Structural and Molecular Biology
Room 3.23, Michael Swann Building
King's Buildings
University of Edinburgh
Edinburgh, EH9 3JR, UK
Tel. 0131 650 7358
http://tinyurl.com/douglasrhouston

-- 
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.

This archive was generated by hypermail 2.1.6 : Wed Dec 31 2014 - 23:22:30 CST