There are about 98 million open addresses on Opengeo.codes, containing a street address, latitude and longitude.
However, it is missing information about the street address, such as city name, county, state, post code. This information is quite important for geocoding.
To fix that, I just reverse geocoded Opengeo's latest dataset. The combined dataset may be downloaded here. (under the same licensing terms as Opengeo's data - the appended data also comes from open sources with similar licensing such as geonames, openstreetmap, openaddresses.io, geocode.xyz and geocoder.ca)
Geoparsing Long Feeds.