I'm looking for a good utility that I can run locally to scrape RADB, ARIN, other RIRs to add to my or customer prefix lists... Anybody have a good tool for this? I currently end up visiting https://www.dan.me.uk/filtergen and creating one off that.
Thoughts?
Crap! Sorry about that, I sent the post as an HTML message. 
there is irrtoolset. If you can get beyond the unfriendly user interface,
it will do all sorts of interesting things, including generating prefix
lists in both cisco and juniper format.
Lots of people don't like irrtoolset, mostly for very good reasons.
However for either very simple or very complicated stuff, it can be quite
useful.
Nick
<http://www.nanog.org/meetings/nanog36/presentations/steenbergen.pdf>
has some pointers to tools Richard wrote (and presented a few times
now) at nanog meetings.
(to save you reading the pdf... which is a good read:
<http://irrpt.sourceforge.net/>
There's also Marco D'Itri's rpsltool:
http://www.linux.it/~md/software/
Of the two, I prefer rpsltool (sorry ras!) - its templating facilities are
better. It's also written in perl which tends to be better for text
processing. PHP is a pain for text processing.
Although both of these these tools are very good, neither of them
implements anything near a complete RPSL parser, which is why I made my
earlier command about the usefulness of irrtoolset for certain types of
user. If you just want basic stuff, irrtoolset will probably do what you
want out of the box. If you want moderately complicated stuff, you may run
into irritating limitations in irrtoolset's rtconfig command. However, if
you want to do really complicated stuff, then it's the only code-base out
there which implements an almost complete RPSL implementation. And there
is a small number of organisations out there who use irrtoolset to its
fullest capabilities.
Nick
I'm looking for a good utility that I can run locally to scrape RADB, ARIN, other RIRs to add to my or customer prefix lists... Anybody have a good tool for this? I currently end up visiting Filter List Generator and creating one off that.
Thoughts?
<http://www.lexa.ru/snar/bgpq/index_en.html>
or you could have alook at
whois -h filtergen.level3.com -- help
if you get blocked by whois rate limiting.
Greetings,
Hannes
The url above links to the predecessor project. The code that I actually use
is available here:
<http://snar.spb.ru/prog/bgpq3/>
Greetings,
Hannes
peval()
I've yet to use this myself but it looks like what you are looking for.
bgpq3
A little bit of topic, but is there a way to get the prefix list and AS number using the description in RADB/others?
For example, for "Commonwealth Bank of Australia" I want to get the following
route: 203.202.158.0/24
descr: Commonwealth Bank of Australia
origin: AS7474
mnt-by: MAINT-AS7474
changed: noc@optus.net.au 20080918
source: RADB
Thanks.
I've always found it helpful to use the "inverse query by" feature, where
you can query for any object that has x "mnt-by" or "origin" and it will
list any objects with that mnt-by or origin you query for.
RADB has this built directly into the Advanced Object Query form on the
website.
-Kyle