Adblock support thread

That doesn't help. Please provide logs of a full adblock run (logread -e "adblock") ... and send it preferably to my maintainers email address (see online doc).

@jwoods thanks :smile:

@dibdot sorry, when i run logread -e "adblock", adblock program normal, logread normal, nothing error, maybe the problem with my wget ssl :frowning:

Hi I've tried to play with email notification functionality. However, it seems that Adblock won't fire emailing even though the condition is met and msmtp working fine (checked in terminal). Am I missing something? Thanks.

Here is the log:

Thu Jan 4 14:47:20 2018 user.notice adblock-[3.4.0] info : start adblock processing (reload)
Thu Jan 4 14:47:20 2018 user.notice adblock-[3.4.0] debug: dns: dnscrypt-proxy, fetch_util: wget (built-in), backup: 1, backup_mode: 0, whitelist_mode: 0, force_srt/_dns: 1/1, mem_total: 252
Thu Jan 4 14:47:20 2018 user.notice adblock-[3.4.0] debug: name: adaway, enabled: 1
Thu Jan 4 14:47:22 2018 user.notice adblock-[3.4.0] debug: name: adaway, mode: backup, count: 379, in_rc: 0, out_rc: 0
Thu Jan 4 14:47:22 2018 user.notice adblock-[3.4.0] debug: name: adaway, mode: merge, count: 379, in_rc: 0, out_rc: 0
.......
Thu Jan 4 14:49:11 2018 user.notice adblock-[3.4.0] debug: name: zeus, enabled: 1
Thu Jan 4 14:49:12 2018 user.notice adblock-[3.4.0] debug: name: zeus, mode: backup, count: 390, in_rc: 0, out_rc: 0
Thu Jan 4 14:49:12 2018 user.notice adblock-[3.4.0] debug: name: zeus, mode: merge, count: 390, in_rc: 0, out_rc: 0
Thu Jan 4 14:49:12 2018 user.notice adblock-[3.4.0] debug: hash_util: /usr/bin/sha256sum, hash: 1b623d1dbb7223d22edc53bda1aade944f40093d35585b3f67d13f47f5c79ea1, out_rc: 1
Thu Jan 4 14:50:58 2018 user.notice adblock-[3.4.0] debug: name: overall, mode: format, count: 77536, in_rc: 0, out_rc: 0
Thu Jan 4 14:50:58 2018 user.notice adblock-[3.4.0] debug: hash_util: /usr/bin/sha256sum, hash: fe5478d49b1c172b53303e4e0b0de771c2b78b18f39751a39bb73a703b564e27, out_rc: 1
Thu Jan 4 14:50:58 2018 user.notice adblock-[3.4.0] debug: cache_util: , cache_rc: , cache_flush: 0, count: 0, out_rc: 0
Thu Jan 4 14:50:59 2018 user.notice adblock-[3.4.0] info : blocklist with overall 77536 domains loaded successfully (Linksys WRT1900AC, Lede Reboot SNAPSHOT r5113-2af10c30fe)

And the config file:

config adblock 'global'
option adb_trigger 'wan'
option adb_enabled '1'
option adb_dns 'dnscrypt-proxy'

config adblock 'extra'
option adb_forcedns '1'
option adb_forcesrt '1'
option adb_debug '1'
option adb_backup '1'
option adb_backupdir '/etc/adblock/backup'
option adb_notify '1'
option adb_notifycnt '150000'

Please make sure that /etc/adblock/adblock.notify is executable and send out mails via mstmp if you call this script locally.

Thx. Found the solution. In addition, I had to install msmtp-mta as it creates the link from sendmail to mstmp. Now works fine.

Thanks for your feedback - with the next update the notify script will look for mstmp & sendmail binary (as fallback).

Hi, is there a possibility to collect statistic data for adblock and draw some graphs pi-hole like?
Is there maybe a collectd-mod-* plugin to enable this statistics?

No.
As a starting point you can raise the dns backend loglevel (probably dnsmasq) and look for "NXDOMAIN" events ... said that, router are very limited devices and for statistics you need to raise the log level of the dns backend, persistently save the logs and write a parser for it ... honestly I've never understand those statistic efforts in projects like Pi-Hole to proof that google & facebook are the biggest in the market ... :wink:

The ā€œfinalā€ 3.4.x update has been released. If nothing major comes up, Iā€™ll backport this version to stable 17.x tree as well.

Edit: done! :relaxed:

3 Likes

never get more then 47000 blocked entries inmy case.... i see you all have over 90000 blocked entries....what is wrong in my case?

What: Lists, Router. Sorting enabled?

my router is TP-Link Archer C 2600, using all checked list's from router side....that is all...what and where i have to add or set to get more entries?

is there any way to block YouTube ads . I have installed adbock addon in my router lede but i'm seen add of youtube.. :-/

I'm at the moment blocking following domains:

ads.doubleclick.net
s.ytimg.com
ad.youtube.com
ads.youtube.com
www.gstatic.com
gstatic.com
clients1.google.com
googleads.g.doubleclick.net
googleads4.g.doubleclick.net
pagead2.googlesyndication.com
pixel.moatads.com
rtd.tubemogul.com
s.innovid.com
pubads.g.doubleclick.net
ssl.google-analytics.com
www-google-analytics.l.google.com
stats.g.doubleclick.net
clients.l.google.com
pagead.l.doubleclick.net
www-googletagmanager.l.google.com
googleadapis.l.google.com

Any addons to see statistics adblock ?

Enable debugging and check logfile. Ensure your SSL downloads are working. You didn't write if you enabled sorting.

i do not now what did you mean with sorting enabled and SSL downloads? btw, here is logfile when debugging enabled:

Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_uci  ::: config: dhcp, change: 
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_uci  ::: config: firewall, change: 
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_jsnup::: status: running, mode: normal mode, cnt: 0, notify: 0, notify_cnt: 0, notify_pid: -
Sat Jan 20 13:55:15 2018 user.info adblock-[3.4.3]: start adblock processing (reload)
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: dns: dnsmasq, fetch_util: /bin/uclient-fetch (-), backup: 0, backup_mode: 0, whitelist_mode: 0, force_srt: 0, force_dns: 0, mem_total: 481
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: name: adaway, enabled: 1
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://adaway.org/hosts.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: name: adguard, enabled: 1
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://filters.adtidy.org/windows/filters/15.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: name: bitcoin, enabled: 1
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: name: blacklist, enabled: 1
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: name: disconnect, enabled: 1
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://s3.amazonaws.com/lists.disconnect.me/simple_malvertising.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: name: dshield, enabled: 1
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://www.dshield.org/feeds/suspiciousdomains_Low.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: name: feodo, enabled: 1
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://feodotracker.abuse.ch/blocklist/?download=domainblocklist, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: name: hphosts, enabled: 1
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://hosts-file.net/ad_servers.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: name: malware, enabled: 1
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://mirror.espoch.edu.ec/malwaredomains/justdomains, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:15 2018 user.debug adblock-[3.4.3]: f_main ::: name: malwarelist, enabled: 1
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_list ::: mode: merge, cnt: 1146, in_rc: 0, out_rc: 0
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: name: openphish, enabled: 1
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://openphish.com/feed.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: name: ransomware, enabled: 1
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://ransomwaretracker.abuse.ch/downloads/RW_DOMBL.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: name: reg_cn, enabled: 1
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://easylist-downloads.adblockplus.org/easylistchina+easylist.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: name: reg_de, enabled: 1
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://easylist-downloads.adblockplus.org/easylistgermany+easylist.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: name: reg_id, enabled: 1
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://easylist-downloads.adblockplus.org/abpindo+easylist.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: name: reg_nl, enabled: 1
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://easylist-downloads.adblockplus.org/easylistdutch+easylist.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:16 2018 user.debug adblock-[3.4.3]: f_main ::: name: reg_pl, enabled: 1
Sat Jan 20 13:55:17 2018 user.debug adblock-[3.4.3]: f_list ::: mode: merge, cnt: 92, in_rc: 0, out_rc: 0
Sat Jan 20 13:55:17 2018 user.debug adblock-[3.4.3]: f_main ::: name: reg_ro, enabled: 1
Sat Jan 20 13:55:17 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://easylist-downloads.adblockplus.org/rolist+easylist.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:17 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:17 2018 user.debug adblock-[3.4.3]: f_main ::: name: reg_ru, enabled: 1
Sat Jan 20 13:55:17 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://easylist-downloads.adblockplus.org/ruadlist+easylist.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:17 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:17 2018 user.debug adblock-[3.4.3]: f_main ::: name: shalla, enabled: 1
Sat Jan 20 13:55:30 2018 user.debug adblock-[3.4.3]: f_list ::: mode: merge, cnt: 33561, in_rc: 0, out_rc: 0
Sat Jan 20 13:55:31 2018 user.debug adblock-[3.4.3]: f_main ::: name: spam404, enabled: 1
Sat Jan 20 13:55:31 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://raw.githubusercontent.com/Dawsey21/Lists/master/main-blacklist.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:31 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:31 2018 user.debug adblock-[3.4.3]: f_main ::: name: sysctl, enabled: 1
Sat Jan 20 13:55:32 2018 user.debug adblock-[3.4.3]: f_list ::: mode: merge, cnt: 20629, in_rc: 0, out_rc: 0
Sat Jan 20 13:55:32 2018 user.debug adblock-[3.4.3]: f_main ::: name: whocares, enabled: 1
Sat Jan 20 13:55:35 2018 user.debug adblock-[3.4.3]: f_list ::: mode: merge, cnt: 13214, in_rc: 0, out_rc: 0
Sat Jan 20 13:55:35 2018 user.debug adblock-[3.4.3]: f_main ::: name: winspy, enabled: 1
Sat Jan 20 13:55:35 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/win10/spy.txt, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:35 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:35 2018 user.debug adblock-[3.4.3]: f_main ::: name: winhelp, enabled: 1
Sat Jan 20 13:55:37 2018 user.debug adblock-[3.4.3]: f_list ::: mode: merge, cnt: 13017, in_rc: 0, out_rc: 0
Sat Jan 20 13:55:37 2018 user.debug adblock-[3.4.3]: f_main ::: name: yoyo, enabled: 1
Sat Jan 20 13:55:37 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://pgl.yoyo.org/adservers/serverlist.php?hostformat=nohtml&showintro=0&mimetype=plaintext, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:37 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:37 2018 user.debug adblock-[3.4.3]: f_main ::: name: zeus, enabled: 1
Sat Jan 20 13:55:37 2018 user.debug adblock-[3.4.3]: f_main ::: url: https://zeustracker.abuse.ch/blocklist.php?download=domainblocklist, rc: 1, src_log: /bin/uclient-fetch: SSL support not available, please install one of the libustream-ssl-* libraries as well as the ca-bundle and ca-certificates packages.
Sat Jan 20 13:55:37 2018 user.debug adblock-[3.4.3]: f_list ::: mode: remove, cnt: 0, in_rc: 1, out_rc: 0
Sat Jan 20 13:55:38 2018 user.debug adblock-[3.4.3]: f_hash ::: hash_util: /usr/bin/sha256sum, hash: 38d8f4286f46c03b2c7dcd06cfaac2bf3253cf8a8eb32c24a89da28e923c7516, out_rc: 1
Sat Jan 20 13:55:49 2018 user.debug adblock-[3.4.3]: f_tld  ::: source: /tmp/tmp.ePpppd/adb_list.overall, cnt: 81659, cnt_srt: 61383, cnt_tld: 46789
Sat Jan 20 13:55:50 2018 user.debug adblock-[3.4.3]: f_list ::: mode: final, cnt: 46789, in_rc: 0, out_rc: 0
Sat Jan 20 13:55:50 2018 user.debug adblock-[3.4.3]: f_hash ::: hash_util: /usr/bin/sha256sum, hash: 38d8f4286f46c03b2c7dcd06cfaac2bf3253cf8a8eb32c24a89da28e923c7516, out_rc: 0
Sat Jan 20 13:55:50 2018 user.debug adblock-[3.4.3]: f_jsnup::: status: enabled, mode: normal mode, cnt: 46789, notify: 0, notify_cnt: 0, notify_pid: -
Sat Jan 20 13:55:50 2018 user.info adblock-[3.4.3]: blocklist with overall 46789 domains loaded successfully (TP-Link Archer C2600, LEDE Reboot 17.01.4 r3560-79f57e422d)

Did you notice these error messages? You can't access https sites without installed ssl library.

ok, i installed libustream-ssl and now my web-browser says insecure connection when access to router?

That is to be expected, as uhttpd now created a self-signed ssl certificate for uhttpd (for accessing luci via https://) - your browser now complains that it can't validate it (which is unavoidable, unless you get a domain and replace the auto-generated ssl certificate with a real one for your domain). It's your router, under your control, so the easiest option is to add an exception for this certificate and "trust" it.

sorry @dibdot , i have a Q, can this program do block on ads that exist in search engine?
and ads do not appear on search engines

1

and there are some web that are not completely in the block like web which ads are not in blocklist and shaped GIF, JPG, etc.

thanks :grin: