[Glass] tODE being disconnected on long "do-its"

Tue Jan 31 12:54:09 PST 2017

On Tue, Jan 31, 2017 at 5:38 PM, Dale Henrichs <
dale.henrichs at gemtalksystems.com> wrote:

> Mariano,
>
> It does look like the socket got closed for some reason (`socket read
> EOF`) ...
>

Exactly!

> so you are using an ssh tunnel to connect to server?
>

Yes. I something like this:

❯ cat bin/netldiPortForwarding.sh
                                               [17:51:47]
#!/bin/sh

#First port is local port, second port is HOST port

lsof -ti:40100 | xargs kill -9
lsof -ti:40200 | xargs kill -9
lsof -ti:40300 | xargs kill -9
lsof -ti:40400 | xargs kill -9
lsof -ti:40500 | xargs kill -9
lsof -ti:40600 | xargs kill -9
lsof -ti:40650 | xargs kill -9

 ssh -c arcfour,blowfish-cbc -XC -N \
        -L 40100:localhost:40100  \
        -L 40200:localhost:40200  \
        -L 40300:localhost:40300  \
        -L 40500:localhost:40500  \
        -L 40600:localhost:40600  \
        -L 40650:localhost:40650  \
        xxserver &

> It would be good to figure out who is doing the closing ... the
> server-side doesn't close and the client-side doesn't have any GemStone
> related timeouts that would close a connection ... so perhaps your guess
> about keepalive is a good one ...
>
> I'll see if anyone here has any insights.
>

To you it does not happen? For me, for example, doing a allInstances (with
a 50GB stone) from a workspace, does trigger this issue.

Maybe something with my sshd conf ? mmm

> Dale
>
> On 01/31/2017 11:54 AM, Mariano Martinez Peck via Glass wrote:
>
> Hi guys,
>
> It already happens to me since a long time. I am using tODE on my local
> machine to connect to remote stones on server. I do this via SSH and
> everything seems to work. However, it happens that when I evaluate
> something from a workspace that may takes several minutes, then my tODE
> image does not respond anymore. The gem does not continue either and I must
> kill the image. Contrary when I run small do it from a workspace, I have no
> problem.
>
> Maybe it is related to SSH and keep alive or something? It seems related
> to the fact I do nothing with tODE (as I can't because tODE gem is locked
> by running whatever I evaluated in a workspace).
>
> From the gemnetobject log all I can see is:
>
>
> *****************************************************
> ****** Abnormal Shutdown at 01/31/2017 13:25:22 EST
> *****************************************************
> -----------------------------------------------------
> GemStone: Error         Fatal
> Network error - text follows:
> socket read EOF
> Error Category: 231169 [GemStone] Number: 4137  Arg Count: 0 Context : 20
> exception : 20
>
> On pcmon log I see:
>
>
> [01/31/17 13:25:22.396 EST]: Client died: Slot    8, PID   28431,
> LostOtFlags    0, sessionId 5 Name Gem15
> [01/31/17 13:25:22.396 EST]: Starting crashed client recovery: Slot 8, PID
> 28431, Name Gem15
>     Cleaned up locked/pinned frame 101760 for crashed process 28431
> (pte.lockedPageFrameId)
>     Cleaned up locked/pinned frame 50206 for crashed process 28431
> (pte.otCachePinnedFrames)
>     Cleaned up locked/pinned frame 26906 for crashed process 28431
> (pte.otCachePinnedFrames)
>     Cleaned up locked/pinned frame 76553 for crashed process 28431
> (pte.otCachePinnedFrames)
>     Disposing free frame cache from slot 8:  9 of 9 frames recovered.
>     Disposing free PCE cache from slot 8:  9 of  9 PCEs recovered.
> [01/31/17 13:25:24.474 EST]: Finished crashed client recovery: Slot 8, PID
> 28431, Name Gem15
>
>
> And on my client machine console I see:
>
>
>  ❯ channel 12: open failed: connect failed: Connection refused
>
>
>
> Does this happen to you too? Any ideas / workaround ?
>
> Thanks
>
> --
> Mariano
> http://marianopeck.wordpress.com
>
>
> _______________________________________________
> Glass mailing listGlass at lists.gemtalksystems.comhttp://lists.gemtalksystems.com/mailman/listinfo/glass
>
>
>

-- 
Mariano
http://marianopeck.wordpress.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gemtalksystems.com/mailman/private/glass/attachments/20170131/b31154bf/attachment.html>