[uWSGI] urgent - ValueError: call stack is not deep enough

[David Montgomery]

I installed 1.2 I guess uwsgi does not like 1.3

Thanks!!!!!!!!!!!!!!!

import gevent
print gevent.__version__

1.3.0

Which gevent version are you using?
Etienne
Why is this happing?
I had a server die have 8 months and used chef to rebuild and this is how
I install uWSGI
pip install uwsgi==2.0.15
/usr/local/bin/uwsgi --yaml /var/upload.uwsgi.yaml
pidfile: /var/run/upload.pid
loop: gevent
gevent: 100
socket: 127.0.0.1:8030
processes: <%= node["cpu"]["total"] %>
b: 32768
master: true
enable-threads: true
listen: 100
logto2: /tmp/upload.log
touch-reload: /var/server/upload_server.py
master-fifo: /tmp/uwsgi_upload_master_fifo
wsgi-file: /var/server/upload_server.py
pp: [/var/server/]
logformat: {"city":"%(city)","region_name":"%(region_name)","time_zone"
:"%(time_zone)","longitude":"%(longitude)","latitude":"%(
"%(country_name)","region":"%(region)","forwarded":"%(
forwarded)","STATUS_CODE":"%(status)","REQUEST_CONTENT_
BODY_SIZE":"%(cl)","switches":"%(switches)","UNIX_TIME":"%(
epoch)","HTTP_REFERER":"%(referer)","HTTP_USER_AGENT":"%
(uagent)","REQUEST_URI":"%(uri)","REQUEST_METHOD":"
%(method)","REMOTE_USER":"%(user)","REMOTE_ADDR":"%(addr)","
HTTP_HOST":"%(host)","SERVER_PROTOCOL":"%(proto)"}
head -n 100 upload.log
your processes number limit is 60091
your memory page size is 4096 bytes
detected max file descriptor number: 1024
- async cores set to 100 - fd table size: 1024
lock engine: pthread robust mutexes
thunder lock: disabled (you can enable it with --thunder-lock)
uwsgi socket 0 bound to TCP address 127.0.0.1:8030 fd 3
Python version: 2.7.12 (default, Dec 4 2017, 14:50:18) [GCC 5.4.0
20160609]
Python main interpreter initialized at 0x9ce3b0
[carbon] added server 127.0.0.1:2003
[carbon] carbon plugin started, 60s frequency, 3s timeout, max retries 0,
retry delay 7s
python threads support enabled
your server socket listen backlog is limited to 100 connections
your mercy for graceful operations on workers is 60 seconds
mapped 9835776 bytes (9605 KB) for 800 cores
*** Operational MODE: preforking+async ***
added [/var/server/] to pythonpath.
##############################
WSGI app 0 (mountpoint='') ready in 0 seconds on interpreter 0x9ce3b0
pid: 21571 (default app)
*** uWSGI is running in multiple interpreter mode ***
spawned uWSGI master process (pid: 21571)
spawned uWSGI worker 1 (pid: 21584, cores: 100)
spawned uWSGI worker 2 (pid: 21585, cores: 100)
spawned uWSGI worker 3 (pid: 21586, cores: 100)
spawned uWSGI worker 4 (pid: 21587, cores: 100)
spawned uWSGI worker 5 (pid: 21588, cores: 100)
spawned uWSGI worker 6 (pid: 21589, cores: 100)
spawned uWSGI worker 7 (pid: 21590, cores: 100)
spawned uWSGI worker 8 (pid: 21591, cores: 100)
*** running gevent loop engine [addr:0x48d3e0] ***
File "src/gevent/greenlet.py", line 527, in
gevent._greenlet.Greenlet.spawn
File "src/gevent/greenlet.py", line 527, in
gevent._greenlet.Greenlet.spawn
File "src/gevent/greenlet.py", line 247, in
gevent._greenlet.Greenlet.__init__
File "src/gevent/greenlet.py", line 247, in
gevent._greenlet.Greenlet.__init__
File "src/gevent/greenlet.py", line 133, in
gevent._greenlet._extract_stack
File "src/gevent/greenlet.py", line 133, in
gevent._greenlet._extract_stack
ValueError: call stack is not deep enough
!!! uWSGI process 21584 got Segmentation Fault !!!
ValueError: call stack is not deep enough
!!! uWSGI process 21585 got Segmentation Fault !!!
File "src/gevent/greenlet.py", line 527, in
gevent._greenlet.Greenlet.spawn
File "src/gevent/greenlet.py", line 527, in
gevent._greenlet.Greenlet.spawn
*** backtrace of 21584 ***
/usr/local/bin/uwsgi(uwsgi_backtrace+0x2c) [0x46b5bc]
/usr/local/bin/uwsgi(uwsgi_segfault+0x21) [0x46b981]
/lib/x86_64-linux-gnu/libc.so.6(+0x354b0) [0x7f8b43b914b0]
/usr/local/bin/uwsgi() [0x48da09]
/usr/local/bin/uwsgi(uwsgi_ignition+0x12e) [0x46bb6e]
/usr/local/bin/uwsgi(uwsgi_worker_run+0x26d) [0x47039d]
/usr/local/bin/uwsgi(uwsgi_init_worker_mount_apps+0) [0x4709a0]
/usr/local/bin/uwsgi() [0x41e53e]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f8b43b7c830]
/usr/local/bin/uwsgi(_start+0x29) [0x41e569]
*** end of backtrace ***
*** backtrace of 21585 ***
/usr/local/bin/uwsgi(uwsgi_backtrace+0x2c) [0x46b5bc]
/usr/local/bin/uwsgi(uwsgi_segfault+0x21) [0x46b981]
/lib/x86_64-linux-gnu/libc.so.6(+0x354b0) [0x7f8b43b914b0]
/usr/local/bin/uwsgi() [0x48da09]
/usr/local/bin/uwsgi(uwsgi_ignition+0x12e) [0x46bb6e]
/usr/local/bin/uwsgi(uwsgi_worker_run+0x26d) [0x47039d]
/usr/local/bin/uwsgi(uwsgi_init_worker_mount_apps+0) [0x4709a0]
/usr/local/bin/uwsgi() [0x41e53e]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f8b43b7c830]
/usr/local/bin/uwsgi(_start+0x29) [0x41e569]
*** end of backtrace ***
File "src/gevent/greenlet.py", line 247, in
gevent._greenlet.Greenlet.__init__
File "src/gevent/greenlet.py", line 247, in
gevent._greenlet.Greenlet.__init__
_______________________________________________
--
_______________________________________________
uWSGI mailing list
http://lists.unbit.it/cgi-bin/mailman/listinfo/uwsgi

[Etienne Robillard]

I installed 1.2 I guess uwsgi does not like 1.3
Thanks!!!!!!!!!!!!!!!

You're welcome! Have fun.

Etienne

On Sun, May 13, 2018 at 5:21 AM, David Montgomery

import gevent
print gevent.__version__

1.3.0
On Sun, May 13, 2018 at 5:17 AM, Etienne Robillard
Which gevent version are you using?
Etienne

Why is this happing?
I had a server die have 8 months and used chef to rebuild and
this is how I install uWSGI
pip install uwsgi==2.0.15
/usr/local/bin/uwsgi --yaml /var/upload.uwsgi.yaml
pidfile: /var/run/upload.pid
loop: gevent
gevent: 100
socket: 127.0.0.1:8030 <http://127.0.0.1:8030>
processes: <%= node["cpu"]["total"] %>
b: 32768
master: true
enable-threads: true
listen: 100
logto2: /tmp/upload.log
touch-reload: /var/server/upload_server.py
master-fifo: /tmp/uwsgi_upload_master_fifo
wsgi-file: /var/server/upload_server.py
pp: [/var/server/]
{"city":"%(city)","region_name":"%(region_name)","time_zone":"%(time_zone)","longitude":"%(longitude)","latitude":"%(latitude)","country_code":"%(country_code)","country_name":"%(country_name)","region":"%(region)","forwarded":"%(forwarded)","STATUS_CODE":"%(status)","REQUEST_CONTENT_BODY_SIZE":"%(cl)","switches":"%(switches)","UNIX_TIME":"%(epoch)","HTTP_REFERER":"%(referer)","HTTP_USER_AGENT":"%(uagent)","REQUEST_URI":"%(uri)","REQUEST_METHOD":"
%(method)","REMOTE_USER":"%(user)","REMOTE_ADDR":"%(addr)","HTTP_HOST":"%(host)","SERVER_PROTOCOL":"%(proto)"}
head -n 100 upload.log
your processes number limit is 60091
your memory page size is 4096 bytes
detected max file descriptor number: 1024
- async cores set to 100 - fd table size: 1024
lock engine: pthread robust mutexes
thunder lock: disabled (you can enable it with --thunder-lock)
uwsgi socket 0 bound to TCP address 127.0.0.1:8030
<http://127.0.0.1:8030> fd 3
Python version: 2.7.12 (default, Dec4 2017, 14:50:18)[GCC
5.4.0 20160609]
Python main interpreter initialized at 0x9ce3b0
[carbon] added server 127.0.0.1:2003 <http://127.0.0.1:2003>
[carbon] carbon plugin started, 60s frequency, 3s timeout,
max retries 0, retry delay 7s
python threads support enabled
your server socket listen backlog is limited to 100 connections
your mercy for graceful operations on workers is 60 seconds
mapped 9835776 bytes (9605 KB) for 800 cores
*** Operational MODE: preforking+async ***
added [/var/server/] to pythonpath.
##############################
WSGI app 0 (mountpoint='') ready in 0 seconds on interpreter
0x9ce3b0 pid: 21571 (default app)
*** uWSGI is running in multiple interpreter mode ***
spawned uWSGI master process (pid: 21571)
spawned uWSGI worker 1 (pid: 21584, cores: 100)
spawned uWSGI worker 2 (pid: 21585, cores: 100)
spawned uWSGI worker 3 (pid: 21586, cores: 100)
spawned uWSGI worker 4 (pid: 21587, cores: 100)
spawned uWSGI worker 5 (pid: 21588, cores: 100)
spawned uWSGI worker 6 (pid: 21589, cores: 100)
spawned uWSGI worker 7 (pid: 21590, cores: 100)
spawned uWSGI worker 8 (pid: 21591, cores: 100)
*** running gevent loop engine [addr:0x48d3e0] ***
File "src/gevent/greenlet.py", line 527, in
gevent._greenlet.Greenlet.spawn
File "src/gevent/greenlet.py", line 527, in
gevent._greenlet.Greenlet.spawn
File "src/gevent/greenlet.py", line 247, in
gevent._greenlet.Greenlet.__init__
File "src/gevent/greenlet.py", line 247, in
gevent._greenlet.Greenlet.__init__
File "src/gevent/greenlet.py", line 133, in
gevent._greenlet._extract_stack
File "src/gevent/greenlet.py", line 133, in
gevent._greenlet._extract_stack
ValueError: call stack is not deep enough
!!! uWSGI process 21584 got Segmentation Fault !!!
ValueError: call stack is not deep enough
!!! uWSGI process 21585 got Segmentation Fault !!!
File "src/gevent/greenlet.py", line 527, in
gevent._greenlet.Greenlet.spawn
File "src/gevent/greenlet.py", line 527, in
gevent._greenlet.Greenlet.spawn
*** backtrace of 21584 ***
/usr/local/bin/uwsgi(uwsgi_backtrace+0x2c) [0x46b5bc]
/usr/local/bin/uwsgi(uwsgi_segfault+0x21) [0x46b981]
/lib/x86_64-linux-gnu/libc.so.6(+0x354b0) [0x7f8b43b914b0]
/usr/local/bin/uwsgi() [0x48da09]
/usr/local/bin/uwsgi(uwsgi_ignition+0x12e) [0x46bb6e]
/usr/local/bin/uwsgi(uwsgi_worker_run+0x26d) [0x47039d]
/usr/local/bin/uwsgi(uwsgi_init_worker_mount_apps+0) [0x4709a0]
/usr/local/bin/uwsgi() [0x41e53e]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f8b43b7c830]
/usr/local/bin/uwsgi(_start+0x29) [0x41e569]
*** end of backtrace ***
*** backtrace of 21585 ***
/usr/local/bin/uwsgi(uwsgi_backtrace+0x2c) [0x46b5bc]
/usr/local/bin/uwsgi(uwsgi_segfault+0x21) [0x46b981]
/lib/x86_64-linux-gnu/libc.so.6(+0x354b0) [0x7f8b43b914b0]
/usr/local/bin/uwsgi() [0x48da09]
/usr/local/bin/uwsgi(uwsgi_ignition+0x12e) [0x46bb6e]
/usr/local/bin/uwsgi(uwsgi_worker_run+0x26d) [0x47039d]
/usr/local/bin/uwsgi(uwsgi_init_worker_mount_apps+0) [0x4709a0]
/usr/local/bin/uwsgi() [0x41e53e]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f8b43b7c830]
/usr/local/bin/uwsgi(_start+0x29) [0x41e569]
*** end of backtrace ***
File "src/gevent/greenlet.py", line 247, in
gevent._greenlet.Greenlet.__init__
File "src/gevent/greenlet.py", line 247, in
gevent._greenlet.Greenlet.__init__
_______________________________________________
uWSGI mailing list
http://lists.unbit.it/cgi-bin/mailman/listinfo/uwsgi
<http://lists.unbit.it/cgi-bin/mailman/listinfo/uwsgi>

--
Etienne Robillard
https://www.isotopesoftware.ca/ <https://www.isotopesoftware.ca/>
_______________________________________________
uWSGI mailing list
http://lists.unbit.it/cgi-bin/mailman/listinfo/uwsgi
<http://lists.unbit.it/cgi-bin/mailman/listinfo/uwsgi>
_______________________________________________
uWSGI mailing list
http://lists.unbit.it/cgi-bin/mailman/listinfo/uwsgi

[Roberto De Ioris]

Post by Etienne Robillard

I installed 1.2 I guess uwsgi does not like 1.3
Thanks!!!!!!!!!!!!!!!

You're welcome! Have fun.
Etienne

Hi, the problem should be fixed in the next gevent release:

https://github.com/unbit/uwsgi/issues/1790