Are there "reserved" AS numbers, the same way there are reserved IP
addresses for non-connected networks?
Yes there are. Something liek the top 1000 or so.
I'll dig up the reference if you want.
Are As numbers considered scarce ? (I think of many small Internet
providers asking for AS numbers just to peer BGP with more than one ISP).
About the same as IP numbers.