Need New DavidC502 Thread

Stan – your patch works. Thankk you!!

Hi I tried the fix on a snapshot build no davidc502 builds,it works partially it do not display the kernel version, on my case lede in in part 1 and original in part 2

Used the same method (WinSCP) as @m4r with the same result.
Maybe Firmware/OS (Kernel) version will be displayed after a reboot cycle?

As soon as I get my USB NAS (Samba) working and then a backup, I'll give it a try.

Thank you for the quick fix!

yes, i can confirm - the kernel content is not identified. thank you.

The offset of 32 is not correct for zImage firmware. The patch is not right.

Somebody with WRT32X please analyse the needed offset (of an mtdblock), where the Linux version is written. (how many characters need to be skipped) @stangri needs that info for updating the app.

See e.g. discussion about the work done for the other routers, starting at:

Or alternatively you may try "hexdump -C /dev/mtd5"

2 Likes

@antonsamoziv Can you please change the topic to something more meaningful, in order to better reflect what is being discussed here?

i've looked at wrt32x dumps of mtd5 and mtd7 saved from factory firmware and after booting into davidc lede.
there is no free-text linux version string.
check out the ..factory.img files:
for wrt3200acm: ascii "ARM linux ......" at offset 32
for wrt32x: hex with nothing decipherable

So, been running htop for 2 days now, today I look at it and memory usage is at 270MB whereas the past day it was 170MB, however nothing in the list, or in ps avxf shows anything using that much memory: See https://pastebin.com/K2zzif1R

Right now it's increasing by 1MB every few minutes or so as far as I can see at a short glance, so it will run out of memory within a few hours, but I have no idea why

What does free output?

root@LEDE-3200ACM:~# free
total used free shared buffers cached
Mem: 510920 313076 197844 1196 6488 19132
-/+ buffers/cache: 287456 223464
Swap: 0 0 0

277M/499M now

edit: 1:35PM (290/499M used)
root@LEDE-3200ACM:~# free
total used free shared buffers cached
Mem: 510920 325952 184968 1196 6488 19136
-/+ buffers/cache: 300328 210592
Swap: 0 0 0

So it's memory usage going up, but no processes actually reflect this memory usage for some reason

From watch /proc/meminfo, looks like Slab, SUnreclaim, and seem to go up consistently, and Active, Active(anon), AnonPages, Mapped, Commited_AS went up a bit at first and seemed to stabilize over the hour I was watching for, so...kernel leak?

Can you try this command to see what might be using memory?

ps -e -o pid,vsz,comm= | sort -n -k 2

root@LEDE-3200ACM:~# ps -e -o pid,vsz,comm= | sort -n -k 2
  PID    VSZ
    1   1328 procd
    2      0 kthreadd
    4      0 kworker/0:0H
    6      0 mm_percpu_wq
    7      0 ksoftirqd/0
    8      0 rcu_sched
    9      0 rcu_bh
   10      0 migration/0
   11      0 cpuhp/0
   12      0 cpuhp/1
   13      0 migration/1
   14      0 ksoftirqd/1
   16      0 kworker/1:0H
  209      0 oom_reaper
  210      0 writeback
  211      0 crypto
  213      0 kblockd
  215      0 ata_sff
  247      0 watchdogd
  281      0 kswapd0
  350      0 pencrypt
  352      0 pdecrypt
  450      0 scsi_eh_0
  451      0 scsi_tmf_0
  454      0 scsi_eh_1
  455      0 scsi_tmf_1
  618      0 irq/43-mmc0
  651      0 irq/39-f1090000
  652      0 irq/40-f1090000
  674      0 ipv6_addrconf
  676      0 dsa_ordered
  714      0 ubi_bgt0d
  721      0 kworker/1:1H
  722      0 kworker/0:1H
  726      0 irq/47-gpio-key
  727      0 irq/48-gpio-key
  836      0 ubifs_bgt0_1
  848      0 ubi_bgt1d
  853      0 ubifs_bgt1_0
 1031    988 ubusd
 1032    676 askfirst
 1100      0 bond0
 1489      0 cryptodev_queue
 1495      0 cfg80211
 1965      0 btmrvl_main_ser
 1966      0 kworker/u5:0
 1975      0 kworker/u5:2
 2011      0 krfcommd
 2362   1004 logd
 2379   1332 rpcd
 2389   1520 haveged
 2470   1448 netifd
 2571   1220 odhcpd
 2619    816 dropbear
 4153   1616 hostapd
 4268   1688 dnscrypt-proxy
 4675   1620 hostapd
 5021   3408 uhttpd
 5153   2576 smbd
 5154   2620 nmbd
 5413   3464 collectd
 5848   1064 sh
 5878   1068 ntpd
18225      0 kworker/0:1
19287    880 dropbear
19288   1064 ash
19481      0 kworker/1:2
21336      0 kworker/0:2
21814      0 kworker/1:0
22931      0 kworker/u4:0
23284      0 kworker/u4:1
23574   1064 sleep
23663      0 kworker/u4:2
23842   1460 ps
23843   1064 sort

and /proc/meminfo is at

root@LEDE-3200ACM:~# cat /proc/meminfo
MemTotal:         510920 kB
MemFree:          144496 kB
MemAvailable:     135136 kB
Buffers:            6488 kB
Cached:            19220 kB
SwapCached:            0 kB
Active:            22280 kB
Inactive:           6808 kB
Active(anon):       4320 kB
Inactive(anon):      256 kB
Active(file):      17960 kB
Inactive(file):     6552 kB
Unevictable:           4 kB
Mlocked:               4 kB
HighTotal:             0 kB
HighFree:              0 kB
LowTotal:         510920 kB
LowFree:          144496 kB
SwapTotal:             0 kB
SwapFree:              0 kB
Dirty:                 0 kB
Writeback:             0 kB
AnonPages:          3408 kB
Mapped:             5884 kB
Shmem:              1196 kB
Slab:             169496 kB
SReclaimable:       5916 kB
SUnreclaim:       163580 kB
KernelStack:         664 kB
PageTables:          348 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:      255460 kB
Committed_AS:       8980 kB
VmallocTotal:     507904 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB

Notable from meminfo compared to an hour ago is Slab was at 167764, SUnreclaim was at 161860, and MemAvailable was at 155344, but I can't even find 20MB worth of additional memory usage in /proc/meminfo's break down?

Usual suspect on rango is mwlwifi.

lsmod doesn't indicate that any module's memory size has changed in the past hour though? unless lsmod doesn't show the current amount of memory allocated for the module and I misunderstood the size column

I don’t believe you can use a simple offset for zImage.

For reference, another hour later:

MemTotal:         510920 kB
MemFree:          102180 kB
MemAvailable:      92824 kB
Buffers:            6488 kB
Cached:            19220 kB
SwapCached:            0 kB
Active:            23080 kB
Inactive:           6808 kB
Active(anon):       5120 kB
Inactive(anon):      256 kB
Active(file):      17960 kB
Inactive(file):     6552 kB
Unevictable:           4 kB
Mlocked:               4 kB
HighTotal:             0 kB
HighFree:              0 kB
LowTotal:         510920 kB
LowFree:          102180 kB
SwapTotal:             0 kB
SwapFree:              0 kB
Dirty:                 0 kB
Writeback:             0 kB
AnonPages:          4220 kB
Mapped:             6128 kB
Shmem:              1196 kB
Slab:             173324 kB
SReclaimable:       5924 kB
SUnreclaim:       167400 kB
KernelStack:         672 kB
PageTables:          348 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:      255460 kB
Committed_AS:      10052 kB
VmallocTotal:     507904 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
root@LEDE-3200ACM:~# ps -e -o pid,vsz,comm= | sort -n -k 2
  PID    VSZ
    1   1328 procd
    2      0 kthreadd
    4      0 kworker/0:0H
    6      0 mm_percpu_wq
    7      0 ksoftirqd/0
    8      0 rcu_sched
    9      0 rcu_bh
   10      0 migration/0
   11      0 cpuhp/0
   12      0 cpuhp/1
   13      0 migration/1
   14      0 ksoftirqd/1
   16      0 kworker/1:0H
  209      0 oom_reaper
  210      0 writeback
  211      0 crypto
  213      0 kblockd
  215      0 ata_sff
  247      0 watchdogd
  281      0 kswapd0
  350      0 pencrypt
  352      0 pdecrypt
  450      0 scsi_eh_0
  451      0 scsi_tmf_0
  454      0 scsi_eh_1
  455      0 scsi_tmf_1
  618      0 irq/43-mmc0
  651      0 irq/39-f1090000
  652      0 irq/40-f1090000
  674      0 ipv6_addrconf
  676      0 dsa_ordered
  714      0 ubi_bgt0d
  721      0 kworker/1:1H
  722      0 kworker/0:1H
  726      0 irq/47-gpio-key
  727      0 irq/48-gpio-key
  836      0 ubifs_bgt0_1
  848      0 ubi_bgt1d
  853      0 ubifs_bgt1_0
 1031    988 ubusd
 1032    676 askfirst
 1100      0 bond0
 1489      0 cryptodev_queue
 1495      0 cfg80211
 1965      0 btmrvl_main_ser
 1966      0 kworker/u5:0
 1975      0 kworker/u5:2
 2011      0 krfcommd
 2362   1004 logd
 2379   1332 rpcd
 2389   1520 haveged
 2470   1448 netifd
 2571   1220 odhcpd
 2619    816 dropbear
 4153   1616 hostapd
 4268   1688 dnscrypt-proxy
 4675   1620 hostapd
 5021   3408 uhttpd
 5153   2576 smbd
 5154   2620 nmbd
 5413   3464 collectd
 5848   1064 sh
 5878   1068 ntpd
18225      0 kworker/0:1
19287    880 dropbear
19288   1068 ash
19481      0 kworker/1:2
21336      0 kworker/0:2
27994      0 kworker/1:1
29583      0 kworker/u4:0
30213   1064 sleep
30246      0 kworker/u4:2
30811      0 kworker/u4:1
30844   1460 ps
30845   1064 sort

Is all the RAM being used mainly cache?

Please run the following and take a look to see if the amount of RAM used has gone down.

sync; echo 1 > /proc/sys/vm/drop_caches
sync; echo 2 > /proc/sys/vm/drop_caches
sync; echo 3 > /proc/sys/vm/drop_caches 

Unfortunately this doesn't seem to be the issue. That does increase the MemFree a little bit, but we're still well beyond what should be being used.

Before sync:

MemTotal:         510920 kB
MemFree:           30436 kB
MemAvailable:      21080 kB
Buffers:            6488 kB
Cached:            19220 kB
SwapCached:            0 kB
Active:            22908 kB
Inactive:           6804 kB
Active(anon):       4944 kB
Inactive(anon):      256 kB
Active(file):      17964 kB
Inactive(file):     6548 kB
Unevictable:           4 kB
Mlocked:               4 kB
HighTotal:             0 kB
HighFree:              0 kB
LowTotal:         510920 kB
LowFree:           30436 kB
SwapTotal:             0 kB
SwapFree:              0 kB
Dirty:                 0 kB
Writeback:             0 kB
AnonPages:          4012 kB
Mapped:             6140 kB
Shmem:              1196 kB
Slab:             179416 kB
SReclaimable:       5928 kB
SUnreclaim:       173488 kB
KernelStack:         672 kB
PageTables:          348 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:      255460 kB
Committed_AS:       9704 kB
VmallocTotal:     507904 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB

After sync:

MemTotal:         510920 kB
MemFree:           50684 kB
MemAvailable:      30400 kB
Buffers:             240 kB
Cached:             7224 kB
SwapCached:            0 kB
Active:             7796 kB
Inactive:           3688 kB
Active(anon):       4272 kB
Inactive(anon):      944 kB
Active(file):       3524 kB
Inactive(file):     2744 kB
Unevictable:           4 kB
Mlocked:               4 kB
HighTotal:             0 kB
HighFree:              0 kB
LowTotal:         510920 kB
LowFree:           50684 kB
SwapTotal:             0 kB
SwapFree:              0 kB
Dirty:                 0 kB
Writeback:             0 kB
AnonPages:          4012 kB
Mapped:             6128 kB
Shmem:              1196 kB
Slab:             175796 kB
SReclaimable:       2312 kB
SUnreclaim:       173484 kB
KernelStack:         696 kB
PageTables:          344 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:      255460 kB
Committed_AS:       9704 kB
VmallocTotal:     507904 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB

Wireless router crashed and the memory at the end looked like this:

MemTotal:         510920 kB
MemFree:           18100 kB
MemAvailable:          0 kB
Buffers:            1580 kB
Cached:             4412 kB
SwapCached:            0 kB
Active:             6748 kB
Inactive:           3300 kB
Active(anon):       4328 kB
Inactive(anon):      924 kB
Active(file):       2420 kB
Inactive(file):     2376 kB
Unevictable:           4 kB
Mlocked:               4 kB
HighTotal:             0 kB
HighFree:              0 kB
LowTotal:         510920 kB
LowFree:           18100 kB
SwapTotal:             0 kB
SwapFree:              0 kB
Dirty:                 0 kB
Writeback:             0 kB
AnonPages:          4064 kB
Mapped:             2416 kB
Shmem:              1196 kB
Slab:             176892 kB
SReclaimable:       2288 kB
SUnreclaim:       174604 kB
KernelStack:         728 kB
PageTables:          344 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:      255460 kB
Committed_AS:      10004 kB
VmallocTotal:     507904 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB

It'll be a couple more days until it bugs out again and starts leaking afaict