Error: Unable to handle kernel paging request at virtual address 7dae15b8
I have a server which is pretty heavily loading, and is randomly freezing. I am wondering if someone can help me understand why.
System Specs:
p4 2.0
1024MB ram
80gb hdd
Problem:
Server will be running fine and then all of a sudden it just does not work. All services like httpd, mail, ftp, ssh can be sucessfully pinged but they will not respond the normal way. I usually have to reboot the server to get it working again. I have copied below a chunk out of /var/log/messages which is where it all starts. This seems to me as the server has run out of memory.
Am I correct?
Jul 27 02:02:39 venus kernel: Code: 8b 44 81 18 0f af fa 89 41 14 01 ef 40 75 23 8b 41 04 8b 11
Jul 27 02:02:39 venus kernel: <1>Unable to handle kernel paging request at virtual address 7dae15b8
Jul 27 02:02:39 venus kernel: printing eip:
Jul 27 02:02:39 venus kernel: c013022f
Jul 27 02:02:39 venus kernel: *pde = 00000000
Jul 27 02:02:39 venus kernel: Oops: 0000
Jul 27 02:02:39 venus kernel: autofs eepro100 mii usb-uhci usbcore ext3 jbd
Jul 27 02:02:39 venus kernel: CPU: 0
Jul 27 02:02:39 venus kernel: EIP: 0010:[kmem_cache_alloc+127/224] Not tainted
Jul 27 02:02:39 venus kernel: EIP: 0010:[<c013022f>] Not tainted
Jul 27 02:02:39 venus kernel: EFLAGS: 00010002
Jul 27 02:02:39 venus kernel:
Jul 27 02:02:39 venus kernel: EIP is at kmem_cache_alloc [kernel] 0x7f (2.4.20-18.7)
Jul 27 02:02:39 venus kernel: eax: 64726168 ebx: c36b21d8 ecx: ebe49000 edx: 00000200
Jul 27 02:02:39 venus kernel: esi: 00000246 edi: 64726168 ebp: ebe49080 esp: f60edca8
Jul 27 02:02:39 venus kernel: ds: 0018 es: 0018 ss: 0018
Jul 27 02:02:39 venus kernel: Process httpd (pid: 1008, stackpage=f60ed000)
Jul 27 02:02:39 venus kernel: Stack: 000001ac f4e4f100 f607d300 00000001 00000000 00000000 c3407248 c3658800
Jul 27 02:02:39 venus kernel: c014fac1 c36b21d8 000001f0 00000000 c3407248 c3407248 c3658800 c0150bc5
Jul 27 02:02:39 venus kernel: c3658800 f7df36a0 c01d1b2f f4441080 00000014 00000000 c3407248 000741ab
Jul 27 02:02:39 venus kernel: Call Trace: [alloc_inode+49/272] alloc_inode [kernel] 0x31 (0xf60edcc8))
Jul 27 02:02:39 venus kernel: Call Trace: [<c014fac1>] alloc_inode [kernel] 0x31 (0xf60edcc8))
Jul 27 02:02:39 venus kernel: [get_new_inode+21/336] get_new_inode [kernel] 0x15 (0xf60edce4))
Jul 27 02:02:39 venus kernel: [<c0150bc5>] get_new_inode [kernel] 0x15 (0xf60edce4))
Jul 27 02:02:39 venus kernel: [__kfree_skb+271/288] __kfree_skb [kernel] 0x10f (0xf60edcf0))
Jul 27 02:02:39 venus kernel: [<c01d1b2f>] __kfree_skb [kernel] 0x10f (0xf60edcf0))
Jul 27 02:02:39 venus kernel: [iget4+210/224] iget4 [kernel] 0xd2 (0xf60edd0c))
Jul 27 02:02:39 venus kernel: [<c0150eb2>] iget4 [kernel] 0xd2 (0xf60edd0c))
Jul 27 02:02:39 venus kernel: [eepro100:__insmod_eepro100_O/lib/modules/2.4.20-18.7/kernel/drivers/+-775078/96] do_get_write_access [jbd] 0x4aa (0xf60edd30))
Jul 27 02:02:39 venus kernel: [<f880dc5a>] do_get_write_access [jbd] 0x4aa (0xf60edd30))
Jul 27 02:02:39 venus kernel: [eepro100:__insmod_eepro100_O/lib/modules/2.4.20-18.7/kernel/drivers/+-697208/96] ext3_lookup [ext3] 0x58 (0xf60edd44))
Jul 27 02:02:39 venus kernel: [<f8820c88>] ext3_lookup [ext3] 0x58 (0xf60edd44))
Jul 27 02:02:39 venus kernel: [real_lookup+79/192] real_lookup [kernel] 0x4f (0xf60edd84))
Jul 27 02:02:39 venus kernel: [<c01469bf>] real_lookup [kernel] 0x4f (0xf60edd84))
Jul 27 02:02:39 venus kernel: [link_path_walk+738/2304] link_path_walk [kernel] 0x2e2 (0xf60edda0))
Jul 27 02:02:39 venus kernel: [<c0146e12>] link_path_walk [kernel] 0x2e2 (0xf60edda0))
Jul 27 02:02:39 venus kernel: [dma_timer_expiry+0/176] dma_timer_expiry [kernel] 0x0 (0xf60eddc4))
Jul 27 02:02:39 venus kernel: [<c01b4ab0>] dma_timer_expiry [kernel] 0x0 (0xf60eddc4))
Jul 27 02:02:39 venus kernel: [tcp_v4_do_rcv+43/256] tcp_v4_do_rcv [kernel] 0x2b (0xf60edddc))
Jul 27 02:02:39 venus kernel: [<c01ff62b>] tcp_v4_do_rcv [kernel] 0x2b (0xf60edddc))
Jul 27 02:02:39 venus kernel: [cleanup_rbuf+174/224] cleanup_rbuf [kernel] 0xae (0xf60ede08))
Jul 27 02:02:39 venus kernel: [<c01f07ce>] cleanup_rbuf [kernel] 0xae (0xf60ede08))
Jul 27 02:02:39 venus kernel: [tcp_recvmsg+1893/2144] tcp_recvmsg [kernel] 0x765 (0xf60ede20))
Jul 27 02:02:39 venus kernel: [<c01f12f5>] tcp_recvmsg [kernel] 0x765 (0xf60ede20))
Jul 27 02:02:39 venus kernel: [d_alloc+28/384] d_alloc [kernel] 0x1c (0xf60ede58))
Jul 27 02:02:39 venus kernel: [<c014f0ac>] d_alloc [kernel] 0x1c (0xf60ede58))
Jul 27 02:02:39 venus kernel: [sprintf+20/32] sprintf [kernel] 0x14 (0xf60ede70))
Jul 27 02:02:39 venus kernel: [<c0220324>] sprintf [kernel] 0x14 (0xf60ede70))
Jul 27 02:02:39 venus kernel: [inet_recvmsg+57/80] inet_recvmsg [kernel] 0x39 (0xf60ede84))
Jul 27 02:02:39 venus kernel: [<c020a849>] inet_recvmsg [kernel] 0x39 (0xf60ede84))
Jul 27 02:02:39 venus kernel: [sock_recvmsg+49/176] sock_recvmsg [kernel] 0x31 (0xf60edeb0))
Jul 27 02:02:39 venus kernel: [<c01ce831>] sock_recvmsg [kernel] 0x31 (0xf60edeb0))
Jul 27 02:02:39 venus kernel: [move_addr_to_user+59/96] move_addr_to_user [kernel] 0x3b (0xf60eded0))
Jul 27 02:02:39 venus kernel: [<c01ce3cb>] move_addr_to_user [kernel] 0x3b (0xf60eded0))
Jul 27 02:02:39 venus kernel: [getname+94/160] getname [kernel] 0x5e (0xf60edf0c))
Jul 27 02:02:39 venus kernel: [<c014670e>] getname [kernel] 0x5e (0xf60edf0c))
Jul 27 02:02:39 venus kernel: [path_lookup+27/48] path_lookup [kernel] 0x1b (0xf60edf20))
Jul 27 02:02:39 venus kernel: [<c01475ab>] path_lookup [kernel] 0x1b (0xf60edf20))
Jul 27 02:02:39 venus kernel: [__user_walk+36/64] __user_walk [kernel] 0x24 (0xf60edf30))
Jul 27 02:02:39 venus kernel: [<c01477f4>] __user_walk [kernel] 0x24 (0xf60edf30))
Jul 27 02:02:39 venus kernel: [vfs_stat+23/80] vfs_stat [kernel] 0x17 (0xf60edf44))
Jul 27 02:02:39 venus kernel: [<c0143d97>] vfs_stat [kernel] 0x17 (0xf60edf44))
Jul 27 02:02:39 venus kernel: [sys_stat64+17/48] sys_stat64 [kernel] 0x11 (0xf60edf70))
Jul 27 02:02:39 venus kernel: [<c0144341>] sys_stat64 [kernel] 0x11 (0xf60edf70))
Jul 27 02:02:39 venus kernel: [net_tx_action+82/176] net_tx_action [kernel] 0x52 (0xf60edf80))
Jul 27 02:02:39 venus kernel: [<c01d59e2>] net_tx_action [kernel] 0x52 (0xf60edf80))
Jul 27 02:02:39 venus kernel: [do_softirq+75/144] do_softirq [kernel] 0x4b (0xf60edf94))
Jul 27 02:02:39 venus kernel: [<c011bf9b>] do_softirq [kernel] 0x4b (0xf60edf94))
Jul 27 02:02:39 venus kernel: [sys_gettimeofday+27/144] sys_gettimeofday [kernel] 0x1b (0xf60edfa0))
Jul 27 02:02:39 venus kernel: [<c011b8cb>] sys_gettimeofday [kernel] 0x1b (0xf60edfa0))
Jul 27 02:02:39 venus kernel: [system_call+51/56] system_call [kernel] 0x33 (0xf60edfc0))
Jul 27 02:02:39 venus kernel: [<c01088c3>] system_call [kernel] 0x33 (0xf60edfc0))
Jul 27 02:02:39 venus kernel: <1>Unable to handle kernel paging request at virtual address 7dae15b8
Jul 27 02:02:39 venus kernel: printing eip:
Jul 27 02:02:39 venus kernel: c013022f
Jul 27 02:02:39 venus kernel: *pde = 00000000
Jul 27 02:02:39 venus kernel: Oops: 0000
Jul 27 02:02:39 venus kernel: autofs eepro100 mii usb-uhci usbcore ext3 jbd
Jul 27 02:02:39 venus kernel: CPU: 0
Jul 27 02:02:39 venus kernel: EIP: 0010:[kmem_cache_alloc+127/224] Not tainted
Jul 27 02:02:39 venus kernel: EIP: 0010:[<c013022f>] Not tainted
Jul 27 02:02:39 venus kernel: EFLAGS: 00010002
Jul 27 02:02:39 venus kernel:
Jul 27 02:02:39 venus kernel: EIP is at kmem_cache_alloc [kernel] 0x7f (2.4.20-18.7)
Jul 27 02:02:39 venus kernel: eax: 64726168 ebx: c36b21d8 ecx: ebe49000 edx: 00000200
Jul 27 02:02:39 venus kernel: esi: 00000246 edi: 64726168 ebp: ebe49080 esp: f60edca8
Jul 27 02:02:39 venus kernel: ds: 0018 es: 0018 ss: 0018
Jul 27 02:02:39 venus kernel: Process httpd (pid: 1008, stackpage=f60ed000)
Jul 27 02:02:39 venus kernel: Stack: 000001ac f4e4f100 f607d300 00000001 00000000 00000000 c3407248 c3658800
Jul 27 02:02:39 venus kernel: c014fac1 c36b21d8 000001f0 00000000 c3407248 c3407248 c3658800 c0150bc5
Jul 27 02:02:39 venus kernel: c3658800 f7df36a0 c01d1b2f f4441080 00000014 00000000 c3407248 000741ab
Jul 27 02:02:39 venus kernel: Call Trace: [alloc_inode+49/272] alloc_inode [kernel] 0x31 (0xf60edcc8))
Jul 27 02:02:39 venus kernel: Call Trace: [<c014fac1>] alloc_inode [kernel] 0x31 (0xf60edcc8))
Jul 27 02:02:39 venus kernel: [get_new_inode+21/336] get_new_inode [kernel] 0x15 (0xf60edce4))
Jul 27 02:02:39 venus kernel: [<c0150bc5>] get_new_inode [kernel] 0x15 (0xf60edce4))
Jul 27 02:02:39 venus kernel: [__kfree_skb+271/288] __kfree_skb [kernel] 0x10f (0xf60edcf0))
Jul 27 02:02:39 venus kernel: [<c01d1b2f>] __kfree_skb [kernel] 0x10f (0xf60edcf0))
Jul 27 02:02:39 venus kernel: [iget4+210/224] iget4 [kernel] 0xd2 (0xf60edd0c))
Jul 27 02:02:39 venus kernel: [<c0150eb2>] iget4 [kernel] 0xd2 (0xf60edd0c))
Jul 27 02:02:39 venus kernel: [eepro100:__insmod_eepro100_O/lib/modules/2.4.20-18.7/kernel/drivers/+-775078/96] do_get_write_access [jbd] 0x4aa (0xf60edd30))
Jul 27 02:02:39 venus kernel: [<f880dc5a>] do_get_write_access [jbd] 0x4aa (0xf60edd30))
Jul 27 02:02:39 venus kernel: [eepro100:__insmod_eepro100_O/lib/modules/2.4.20-18.7/kernel/drivers/+-697208/96] ext3_lookup [ext3] 0x58 (0xf60edd44))
Jul 27 02:02:39 venus kernel: [<f8820c88>] ext3_lookup [ext3] 0x58 (0xf60edd44))
Jul 27 02:02:39 venus kernel: [real_lookup+79/192] real_lookup [kernel] 0x4f (0xf60edd84))
Jul 27 02:02:39 venus kernel: [<c01469bf>] real_lookup [kernel] 0x4f (0xf60edd84))
Jul 27 02:02:39 venus kernel: [link_path_walk+738/2304] link_path_walk [kernel] 0x2e2 (0xf60edda0))
Jul 27 02:02:39 venus kernel: [<c0146e12>] link_path_walk [kernel] 0x2e2 (0xf60edda0))
Jul 27 02:02:39 venus kernel: [dma_timer_expiry+0/176] dma_timer_expiry [kernel] 0x0 (0xf60eddc4))
Jul 27 02:02:39 venus kernel: [<c01b4ab0>] dma_timer_expiry [kernel] 0x0 (0xf60eddc4))
Jul 27 02:02:39 venus kernel: [tcp_v4_do_rcv+43/256] tcp_v4_do_rcv [kernel] 0x2b (0xf60edddc))
Jul 27 02:02:39 venus kernel: [<c01ff62b>] tcp_v4_do_rcv [kernel] 0x2b (0xf60edddc))
Jul 27 02:02:39 venus kernel: [cleanup_rbuf+174/224] cleanup_rbuf [kernel] 0xae (0xf60ede08))
Jul 27 02:02:39 venus kernel: [<c01f07ce>] cleanup_rbuf [kernel] 0xae (0xf60ede08))
Jul 27 02:02:39 venus kernel: [tcp_recvmsg+1893/2144] tcp_recvmsg [kernel] 0x765 (0xf60ede20))
Jul 27 02:02:39 venus kernel: [<c01f12f5>] tcp_recvmsg [kernel] 0x765 (0xf60ede20))
Jul 27 02:02:39 venus kernel: [d_alloc+28/384] d_alloc [kernel] 0x1c (0xf60ede58))
Jul 27 02:02:39 venus kernel: [<c014f0ac>] d_alloc [kernel] 0x1c (0xf60ede58))
Jul 27 02:02:39 venus kernel: [sprintf+20/32] sprintf [kernel] 0x14 (0xf60ede70))
Jul 27 02:02:39 venus kernel: [<c0220324>] sprintf [kernel] 0x14 (0xf60ede70))
Jul 27 02:02:39 venus kernel: [inet_recvmsg+57/80] inet_recvmsg [kernel] 0x39 (0xf60ede84))
Jul 27 02:02:39 venus kernel: [<c020a849>] inet_recvmsg [kernel] 0x39 (0xf60ede84))
Jul 27 02:02:39 venus kernel: [sock_recvmsg+49/176] sock_recvmsg [kernel] 0x31 (0xf60edeb0))
Jul 27 02:02:39 venus kernel: [<c01ce831>] sock_recvmsg [kernel] 0x31 (0xf60edeb0))
Jul 27 02:02:39 venus kernel: [move_addr_to_user+59/96] move_addr_to_user [kernel] 0x3b (0xf60eded0))
Jul 27 02:02:39 venus kernel: [<c01ce3cb>] move_addr_to_user [kernel] 0x3b (0xf60eded0))
Jul 27 02:02:39 venus kernel: [getname+94/160] getname [kernel] 0x5e (0xf60edf0c))
Jul 27 02:02:39 venus kernel: [<c014670e>] getname [kernel] 0x5e (0xf60edf0c))
Jul 27 02:02:39 venus kernel: [path_lookup+27/48] path_lookup [kernel] 0x1b (0xf60edf20))
Jul 27 02:02:39 venus kernel: [<c01475ab>] path_lookup [kernel] 0x1b (0xf60edf20))
Jul 27 02:02:39 venus kernel: [__user_walk+36/64] __user_walk [kernel] 0x24 (0xf60edf30))
Jul 27 02:02:39 venus kernel: [<c01477f4>] __user_walk [kernel] 0x24 (0xf60edf30))
Jul 27 02:02:39 venus kernel: [vfs_stat+23/80] vfs_stat [kernel] 0x17 (0xf60edf44))
Jul 27 02:02:39 venus kernel: [<c0143d97>] vfs_stat [kernel] 0x17 (0xf60edf44))
Jul 27 02:02:39 venus kernel: [sys_stat64+17/48] sys_stat64 [kernel] 0x11 (0xf60edf70))
Jul 27 02:02:39 venus kernel: [<c0144341>] sys_stat64 [kernel] 0x11 (0xf60edf70))
Jul 27 02:02:39 venus kernel: [net_tx_action+82/176] net_tx_action [kernel] 0x52 (0xf60edf80))
Jul 27 02:02:39 venus kernel: [<c01d59e2>] net_tx_action [kernel] 0x52 (0xf60edf80))
Jul 27 02:02:39 venus kernel: [do_softirq+75/144] do_softirq [kernel] 0x4b (0xf60edf94))
Jul 27 02:02:39 venus kernel: [<c011bf9b>] do_softirq [kernel] 0x4b (0xf60edf94))
Jul 27 02:02:39 venus kernel: [sys_gettimeofday+27/144] sys_gettimeofday [kernel] 0x1b (0xf60edfa0))
Jul 27 02:02:39 venus kernel: [<c011b8cb>] sys_gettimeofday [kernel] 0x1b (0xf60edfa0))
Jul 27 02:02:39 venus kernel: [system_call+51/56] system_call [kernel] 0x33 (0xf60edfc0))
Jul 27 02:02:39 venus kernel: [<c01088c3>] system_call [kernel] 0x33 (0xf60edfc0))
