Core dump messages in /var/log/messages!

Mar 27 08:05:44 DNTX014 abrt[10150]: Saved core dump of pid 5803
(/usr/local/sbin/nginx) to /var/spool/abrt/ccpp-2014-03-27-12:05:44-5803
(60538880 bytes)

Could someone tell me what is that ?

Regards.
Shahzaib

Hello!

On Thu, Mar 27, 2014 at 12:37:29PM +0500, shahzaib shahzaib wrote:

Mar 27 08:05:44 DNTX014 abrt[10150]: Saved core dump of pid 5803
(/usr/local/sbin/nginx) to /var/spool/abrt/ccpp-2014-03-27-12:05:44-5803
(60538880 bytes)

Could someone tell me what is that ?

http://wiki.nginx.org/Debugging


Maxim D.
http://nginx.org/

Hi,

Mar 27 08:05:44 DNTX014 abrt[10150]: Saved core dump of pid 5803
(/usr/local/sbin/nginx) to
/var/spool/abrt/ccpp-2014-03-27-12:05:44-5803 (60538880 bytes)

Could someone tell me what is that ?

Its a crash.

Provide output of “/usr/local/sbin/nginx -V” and check:
http://nginx.org/en/docs/debugging_log.html

Regards,

Lukas

nginx -V
nginx version: nginx/1.2.8

I have found not a single issue with 1.2.1 but all other versions have
some
kind of issue.

Regards.
Shahzaib

sorry the same issue have found with nginx-1.2.1 :frowning:

I enabled debugging and following is the error_log :

2014/03/27 15:26:09 [debug] 8185#0: *2118538 http write filter: l:0 f:1
s:141632
2014/03/27 15:26:09 [debug] 8185#0: *2118538 http write filter limit
131072
2014/03/27 15:26:09 [debug] 8185#0: *2118538 writev: 131072
2014/03/27 15:26:09 [debug] 8185#0: *2118538 http write filter
000000000130A8B0
2014/03/27 15:26:09 [debug] 8185#0: *2118538 event timer del: 27:
1395916149293
2014/03/27 15:26:09 [debug] 8185#0: *2118538 event timer add: 27:
213:1395915969928
2014/03/27 15:26:09 [debug] 8185#0: *2118538 http copy filter: -2
“/files/videos/2014/03/24/1395674643a4202-240.mp4?”
2014/03/27 15:26:09 [debug] 8185#0: *2118538 http writer output filter:
-2,
“/files/videos/2014/03/24/1395674643a4202-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118703 event timer del: 90:
1395915969743
2014/03/27 15:26:09 [debug] 8178#0: *2118703 http run request:
“/files/videos/2014/03/25/13957610474dea7-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118703 http writer handler:
“/files/videos/2014/03/25/13957610474dea7-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118703 event timer add: 90:
180000:1395916149744
2014/03/27 15:26:09 [debug] 8178#0: *2118688 event timer del: 79:
1395915969760
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http run request:
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http writer handler:
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http output filter
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http copy filter:
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http postpone filter
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?” 0000000000000000
2014/03/27 15:26:09 [debug] 8178#0: *2118688 write old buf t:1 f:0
0000000001E92650, pos 0000000001EF2650, size: 131072 file: 0, size: 0
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http write filter: l:0 f:1
s:131072
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http write filter limit
131072
2014/03/27 15:26:09 [debug] 8178#0: *2118688 writev: 131072
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http write filter
0000000000000000
2014/03/27 15:26:09 [debug] 8178#0: *2118688 event timer add: 79:
213:1395915969973
2014/03/27 15:26:09 [debug] 8178#0: *2118688 read: 80, 0000000001E92650,
524288, 3306231
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http postpone filter
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?” 0000000001493110
2014/03/27 15:26:09 [debug] 8178#0: *2118688 write new buf t:1 f:0
0000000001E92650, pos 0000000001E92650, size: 524288 file: 0, size: 0
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http write filter: l:0 f:1
s:524288
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http copy filter: -2
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http writer output filter:
-2,
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”

Regards.
Shahzaib

Thats not the complete output of -V (capital letter). Either you
truncated the output by yourself or you sent us the output of -v.

Please send the complete output of “nginx -V”, where the V is a
capital letter.

Also compile nginx without third party modules.

And, also important, upgrade to latest stable1.4.7.

[[email protected] nginx-1.2.1]# nginx -V
nginx version: nginx/1.2.1
built by gcc 4.4.6 20120305 (Red Hat 4.4.6-4) (GCC)
configure arguments: --add-module=/root/nginx_mod_h264_streaming-2.2.7
–with-http_flv_module --with-file-aio --sbin-path=/usr/local/sbin
–with-debug

we’re using nginx for streaming videos like youtube.com. Usually it is
5000
concurrent connections on the server.

Should we upgrde to 1.4.7 . It is stable ?

Hi,

[[email protected] nginx-1.2.1]# nginx -V
nginx version: nginx/1.2.1
built by gcc 4.4.6 20120305 (Red Hat 4.4.6-4) (GCC)
configure arguments: --add-module=/root/nginx_mod_h264_streaming-2.2.7
–with-http_flv_module --with-file-aio --sbin-path=/usr/local/sbin
–with-debug

nginx_mod_h264_streaming is a unsupported third party module and
probably
causing your crash. There is generally no support for those modules on
the mailing list.

Drop nginx_mod_h264_streaming and migrate the official
ngx_http_mp4_module:
http://nginx.org/en/docs/http/ngx_http_mp4_module.html

Please be aware that this also means changing configurations.

And yes, nginx-1.4.7 is stable.

Regards,

Lukas

Thanks Lukas, now i saw these errors in /var/log/messages. Also due to
3rd
party module ?

Mar 27 12:04:47 DNTX002 kernel: nginx[8190]: segfault at 40174353c ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx[400000+92000]
Mar 27 12:04:47 DNTX002 xinetd[6599]: START: nrpe pid=9442
from=209.59.234.13
Mar 27 12:04:47 DNTX002 abrtd: Directory ‘ccpp-2014-03-27-16:04:47-8190’
creation detected
Mar 27 12:04:47 DNTX002 abrt[9441]: Saved core dump of pid 8190
(/usr/local/sbin/nginx) to /var/spool/abrt/ccpp-2014-03-27-16:04:47-8190
(67911680 bytes)
Mar 27 12:04:47 DNTX002 xinetd[6599]: EXIT: nrpe status=0 pid=9442
duration=0(sec)
Mar 27 12:04:48 DNTX002 abrtd: Executable ‘/usr/local/sbin/nginx’
doesn’t
belong to any package
Mar 27 12:04:48 DNTX002 abrtd: ‘post-create’ on
‘/var/spool/abrt/ccpp-2014-03-27-16:04:47-8190’ exited with 1
Mar 27 12:04:48 DNTX002 abrtd: Corrupted or bad directory
‘/var/spool/abrt/ccpp-2014-03-27-16:04:47-8190’, deleting

Regards.
Shahzaib

nginx -V
nginx version: nginx/1.2.8

Thats not the complete output of -V (capital letter). Either you
truncated the output by yourself or you sent us the output of -v.

Please send the complete output of “nginx -V”, where the V is a
capital letter.

Also compile nginx without third party modules.

Thanks,

Lukas

You can check the following version now :

[[email protected] nginx-1.4.7]# nginx -V
nginx version: nginx/1.4.7
built by gcc 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC)
configure arguments: --with-http_mp4_module --with-http_flv_module
–with-file-aio --sbin-path=/usr/local/sbin --with-debug

Still the /var/log/messages showing the following errors :

Mar 27 12:32:12 DNTX002 kernel: nginx[12215]: segfault at 40172f51c ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:12 DNTX002 abrt[12401]: File ‘/usr/local/sbin/nginx’ seems
to
be deleted
Mar 27 12:32:12 DNTX002 abrt[12401]: Saved core dump of pid 12215
(/usr/local/sbin/nginx) to
/var/spool/abrt/ccpp-2014-03-27-16:32:12-12215
(38105088 bytes)
Mar 27 12:32:12 DNTX002 abrtd: Directory
‘ccpp-2014-03-27-16:32:12-12215’
creation detected
Mar 27 12:32:12 DNTX002 abrtd: Executable ‘/usr/local/sbin/nginx’
doesn’t
belong to any package
Mar 27 12:32:12 DNTX002 abrtd: ‘post-create’ on
‘/var/spool/abrt/ccpp-2014-03-27-16:32:12-12215’ exited with 1
Mar 27 12:32:12 DNTX002 abrtd: Corrupted or bad directory
‘/var/spool/abrt/ccpp-2014-03-27-16:32:12-12215’, deleting
Mar 27 12:32:29 DNTX002 xinetd[6599]: START: nrpe pid=12414
from=209.59.234.13
Mar 27 12:32:30 DNTX002 xinetd[6599]: EXIT: nrpe status=0 pid=12414
duration=1(sec)
Mar 27 12:32:36 DNTX002 kernel: nginx[12226]: segfault at 401598e6c ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:36 DNTX002 abrt[12421]: File ‘/usr/local/sbin/nginx’ seems
to
be deleted
Mar 27 12:32:36 DNTX002 abrt[12421]: Saved core dump of pid 12226
(/usr/local/sbin/nginx) to
/var/spool/abrt/ccpp-2014-03-27-16:32:36-12226
(54018048 bytes)
Mar 27 12:32:36 DNTX002 abrtd: Directory
‘ccpp-2014-03-27-16:32:36-12226’
creation detected
Mar 27 12:32:36 DNTX002 abrtd: Executable ‘/usr/local/sbin/nginx’
doesn’t
belong to any package
Mar 27 12:32:36 DNTX002 abrtd: ‘post-create’ on
‘/var/spool/abrt/ccpp-2014-03-27-16:32:36-12226’ exited with 1
Mar 27 12:32:36 DNTX002 abrtd: Corrupted or bad directory
‘/var/spool/abrt/ccpp-2014-03-27-16:32:36-12226’, deleting
Mar 27 12:32:42 DNTX002 kernel: nginx[12220]: segfault at 400ffafac ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:42 DNTX002 abrt[12426]: File ‘/usr/local/sbin/nginx’ seems
to
be deleted
Mar 27 12:32:42 DNTX002 abrt[12426]: Not saving repeating crash in
‘/usr/local/sbin/nginx’
Mar 27 12:32:49 DNTX002 kernel: nginx[12212]: segfault at 400ffb0fc ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:49 DNTX002 abrt[12431]: File ‘/usr/local/sbin/nginx’ seems
to
be deleted
Mar 27 12:32:49 DNTX002 abrt[12431]: Not saving repeating crash in
‘/usr/local/sbin/nginx’
Mar 27 12:32:54 DNTX002 kernel: nginx[12219]: segfault at 400ff740c ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:54 DNTX002 abrt[12434]: File ‘/usr/local/sbin/nginx’ seems
to
be deleted
Mar 27 12:32:54 DNTX002 abrt[12434]: Not saving repeating crash in
‘/usr/local/sbin/nginx’

One quick question, i’ve updated nginx to 1.4.7 with http_mp4_module.
What
if i go with the same config as before ? i.e

server {
listen 80;
server_name storage10.domain.com storage10.gear3rd.com
storage10.gear3rd.net;
client_max_body_size 800m;

limit_rate 250k;

#    access_log  /websites/theos.in/logs/access.log  main;
    add_header "X-Content-Type-Options" "nosniff";
            add_header Content-Type text/plain;
    add_header X-Download-Options noopen ;
    location / {
        root   /var/www/html/domain;
        index index.html index.htm index.php;
       autoindex off;

}
location ~ .(flv|jpg|jpeg)$ {
flv;
root /var/www/html/domain;

aio on;

directio 512;

output_buffers 1 2m;

            expires 7d;
            valid_referers none blocked tune.pk *.tune.pk 

.facebook.com.
twitter.com *.domain.com *.gear3rd.net tunemedia.tv www.tunemedia.tv
embed.tunemedia.tv;
if ($invalid_referer) {
return 403;
}
}
location ~ -720.(mp4)$ {
mp4;
expires 7d;

limit_rate 1000k;

            root /var/www/html/domain;
             valid_referers none blocked  tune.pk *.tune.pk *.

facebook.com *.twitter.com *.domain.com *.gear3rd.net tunemedia.tv
www.tunemedia.tv embed.tunemedia.tv;
if ($invalid_referer) {
return 403;
}
}
location ~ -480.(mp4)$ {
mp4;
expires 7d;
limit_rate 250k;
root /var/www/html/domain;
valid_referers none blocked tune.pk *.tune.pk *.
facebook.com *.twitter.com *.domain.com *.gear3rd.net tunemedia.tv
www.tunemedia.tv embed.tunemedia.tv;
if ($invalid_referer) {
return 403;
}
}
location ~ .(mp4)$ {
mp4;
expires 7d;

add_header “X-Content-Type-Options” “nosniff”;

add_header Content-Type text/plain;

            root /var/www/html/domain;
             valid_referers none blocked  tune.pk *.tune.pk *.

facebook.com *.twitter.com *.domain.com *.gear3rd.net tunemedia.tv
www.tunemedia.tv embed.tunemedia.tv;
if ($invalid_referer) {
return 403;
}
}

pass the PHP scripts to FastCGI server listening on 127.0.0.1:9000

    location ~ \.php$ {
        root /var/www/html/domain;
        fastcgi_pass   127.0.0.1:9000;
       fastcgi_index  index.php;
        fastcgi_param  SCRIPT_FILENAME

$document_root$fastcgi_script_name;
include fastcgi_params;
fastcgi_read_timeout 10000;
}

    location ~ /\.ht {
        deny  all;
    }

}

Regards.
Shahzaib

Hello!

On Thu, Mar 27, 2014 at 05:32:08PM +0500, shahzaib shahzaib wrote:

Mar 27 12:32:12 DNTX002 kernel: nginx[12215]: segfault at 40172f51c ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:12 DNTX002 abrt[12401]: File ‘/usr/local/sbin/nginx’ seems to
be deleted

According to the logs, it’s previous version which segfaults (note
that the file was deleted, hence the version on disk, if any, is
different one).

Likley you’ve forgot to upgrade the binary running.


Maxim D.
http://nginx.org/

I upgraded nginx to nginx-1.4.7 and then issued the command nginx -s
reload. Maybe nginx -s reload didn’t actually used the latest binary.
Well,
now i killed all other nginx using following command :

killall -9 nginx
nginx (to start new binary)

Ohhh. THANKS a lot for explaining me that. :slight_smile:

Sorry a silly job from my end .

I’ll monitor logs for while and let you know about the progress. I had a
quick question in previous reply. Could you please check that one ?

Regards.
Shahzaib

Hello!

On Thu, Mar 27, 2014 at 06:08:44PM +0500, shahzaib shahzaib wrote:

I upgraded nginx to nginx-1.4.7 and then issued the command nginx -s
reload. Maybe nginx -s reload didn’t actually used the latest binary. Well,
now i killed all other nginx using following command :

killall -9 nginx
nginx (to start new binary)

The “nginx -s reload” is a configuration reload command. It won’t
even try to change a binary, it will just sent a SIGHUP to a
running master process.

See here for a documentation on how to control nginx properly:
http://nginx.org/en/docs/control.html


Maxim D.
http://nginx.org/

Hi,

One quick question, i’ve updated nginx to 1.4.7 with http_mp4_module.
What if i go with the same config as before ? i.e

That should work, as all you really need to do is to use the “mp4;”
keyword.

(I was not aware that config keyword is actually exactly the same
between
the third party module and the official module).

Regards,

Lukas

Thanks for help guyz. :slight_smile:

Regards.
Shahzaib

This forum is not affiliated to the Ruby language, Ruby on Rails framework, nor any Ruby applications discussed here.

| Privacy Policy | Terms of Service | Remote Ruby Jobs