Author Topic: VAM Data for Airports , how old is it ?  (Read 222 times)

lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
VAM Data for Airports , how old is it ?
« on: July 07, 2018, 11:13:06 AM »
The airports table as supplied by VAM seems to have a substantial amount of missing or incorrect data. \

FAJS now has the ICAO code of FAOR and existing FAOR is not a registered airfield in South Aftrica and should be deleted

Many new airports that are now in use are not in the data which i think was created around 5 or 6 years ago.

I hope in the new release that a better database is supplied so that so many corrections dont have to be made

lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #1 on: July 07, 2018, 01:36:16 PM »
i have found a database that seems to be a bit more upto date just need to upload it to airports table avoiding duplicates
 the database can be found at https://openflights.org/data.html

obviously i will use MYSQL and a couple of scripts to do this and again if anybody interested in these scripts then I will post them on here

lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #2 on: July 10, 2018, 04:42:32 PM »
the VAM database after investigation seems to be a clone of http://ourairports.com/data/airports.csv

The latest version is dated 10th July 2018  which is very much more recent
however I believe that this database is also not very accurate at times but is closer but still contains many errors

~/Sites/vamroutes/vamroutesdata/csvdata/airports.csv:19783: 2792,"FAJS","large_airport","OR Tambo International Airport",-26.1392,28.246,5558,"AF","ZA","ZA-GT","Johannesburg","yes","FAOR","JNB",,"http://www.acsa.co.za/home.asp?pid=228","http://en.wikipedia.org/wiki/OR_Tambo_International_Airport","Johannesburg International Airport"
~/Sites/vamroutes/vamroutesdata/csvdata/airports.csv:19863: 31055,"FAOR","large_airport","OR Tambo International

Yes two records for the same airport ?


VBD201

  • Jr. Member
  • **
  • Posts: 60
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #3 on: July 11, 2018, 05:38:50 PM »
hello, you can send me the table if possible in SQL format.
Thank you

lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #4 on: July 11, 2018, 06:22:35 PM »
i am busy removing duplicates etc but it will be ready soon , no guarantees its 100% perfect but you can judge for yourself later

lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #5 on: July 12, 2018, 06:20:19 AM »
i think i will end up with just over 13,400 good airports in my database as i will cross-check all names and entries with arinc data from navigraph latest cycle as I am a subscriber to that.  Yes many airports will be chopped especially those very small and private airfields or plantation airstrips in Brazil etc.  I want to have airports that you can get routes for from Simbrief and for many pilots who fly on-line they need to be in IFR mode as VFR is not generally allowed on-line much.   
My database is getting there but it will take a bit longer than i was hoping for due to the errors , etc. 

CURRENT NAVIGRAPH ARINC 1807  CONTAINS JUST UNDER 13500 AIRPORTS WITH CURRENT LONGITUDE AND LATITUDE

This will bee my base for collating the airports table  and yes there is only FAOR and not FAJS in Navigraph
« Last Edit: July 12, 2018, 06:30:29 AM by lesmar »

lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #6 on: July 12, 2018, 08:06:14 AM »
The current Airports Table seems to have a lot of information that is not used or required and some information that would be ideal to have

Do we need fields such as scheduled_service or keywords etc if they are not used ?

The flight duration field on routes table could be easily dynamically done as we have both the airport code and the co-ordinates but what is missing on the airports table is the GMT offset and timezone of the airport,  this makes calculating flight time easier as departure and arrival times are usually in local time eg. FIMP Mauritius to EGLL London Heatrow d├ęparts at 22:00 and arrives at 06:30 for example now just subtracting times gives you 8:30 flight time but since FIMP has a Gmt offset of +3 and EGLL has GMT offset of 0 then the flight time is in fact 11:30 approx. 
therefore it makes sense to add these to airports rather than having data that is redundant
Taking about routes there is a good formula that will calculate based on the shape of the earth the number of nautical miles between airports .  I will amend my VAM to show this distance on the routes display like the duration as a guideline for pilots
I will publish all changes I make in here as a sort of addition to VAM and perhaps it will get put into the next version

lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #7 on: July 12, 2018, 08:37:00 PM »
got the basic navigraph data into a table now to api or copy missing details for each airport from other sources

CharlieBravo

  • Newbie
  • *
  • Posts: 38
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #8 on: July 13, 2018, 12:18:06 AM »
Great! Look forward to it.

VBD201

  • Jr. Member
  • **
  • Posts: 60
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #9 on: July 13, 2018, 08:05:25 AM »
Great!

lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #10 on: July 17, 2018, 12:07:43 PM »
i have matched up around 8500 Navigraph Airports with some of the other tables , I think and believe some of these tables are not correct as many hold a 3 character code for the airport for many USA airports such as 1KS  where Navigraph and ICAO code is K1KS  so i can correct a few more of the 2000 airports i need data for.

lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #11 on: July 18, 2018, 02:20:51 PM »
I now have 4000 routes mapped to my 20 hubs against 6000 'Navigraph Airports' that have a good ICAO (navigational code ) and IATA (passenger code) set.  For example  Heathrow is for pilots  'EGLL'  and for passengers is 'LHR'.

Next i add the co-ordinates of the airports and thus i can calculate the distance between airports .

I need also to trim the other database tables linked to the Airports so that they in-turn do not have redundant data.

Personally I think it is good to have 6000 good airports rather than 30,000 airports that are often a strip of grass in a plantation in Brazil and dont have an IATA code.  OF course if you set up a bush flying VAM with VFR then you are ok but i want really to have a simulation of a real world environment i.e. actual real world routes etc.

quepsi83

  • Jr. Member
  • **
  • Posts: 88
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #12 on: July 18, 2018, 08:59:08 PM »
A lot of work getting to the point you've reached. "Congratulations".

The following is merely a comment. Please take it as such...

Using VATSPY as a similar example - it contains a database of airports, FIRs, Regions, etc. worldwide.  Over the years - 10 by my calendar - it has become a fragmented mess.  There is now a concentrated effort to harness the multiple (and varied) collection of database... each 'version' maintained by different groups of individuals.

My instance if VAM is centered around Business/Executive Charters... flights which may indeed land on a grass strip somewhere.  In fact, just yesterday, I flew into an airport in Western Australia  - one that supports the Gold Mining industry down there... serviced by Cobham Aviation using a fleet or RJ100's.  To my surprise, a grass strip loomed in the distance... LOL Clearly not a place you'd want to land at night?  Key is... FSX (and I suspect xPlane and P3D) had this ICAO in the database.

Cheers,

Keith

lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #13 on: July 19, 2018, 05:52:22 AM »
Thanks for the message Keith,

I am sure that if I expand my data collection even further i could get close to having a database that is as 'good as it gets' . In my example i wanted to set up a continent passenger and freight virtual airline for Africa.  Thus I don't use GA aircraft etc and only want to fly routes that have both ICAO and IATA codes. With the worldwide data i have at my disposal for flights and my 20 hub airports i have got going with the process of generating by PHP and MYSQL an automatic route builder that in its early stages has created 4000 route records that either start or end at one of my hub airports.
I have the ICAO code for aircraft that has flown that route and as such using other database and probably some manual input from wikipedia etc i can create all my fleet records again using PHP and MYSQL. 

As you may have guessed my method is to use a lot of available information in a way that for VAM I can import it rather than key it in on the screen.

This means that for any user of VAM that needs a passenger Virtual Airline like mine can just send me their HUB table and the rest I can build and send back as MYSQL scripts just like setting VAM up in the first place. At least they will have something to get going with instead of spending hours and hours researching and typing data into VAM.

Regarding the Fleet records for each Aircraft type I have a set of small side view images of aircraft that i use in the image URL of the fleet record these will be zipped and sent with the MYSQL scripts to the requester.




lesmar

  • Newbie
  • *
  • Posts: 37
    • View Profile
Re: VAM Data for Airports , how old is it ?
« Reply #14 on: July 20, 2018, 07:54:46 AM »
good news so far in my data source of world routes (timetable) i have just over 190,000 entries
In the first pass of matching to Navigraph Airport Data and these routes I have a success of 182,000 where both the departure and arrival airport in the route can be matched to my Navigraph Airports table.
Yes there are between 8000 and 9000 unmatched records which i am now going to look at and i think many may be items such as FAJS instead of FAOR so I will try to match using other tables and the IATA code like JNB for Johannesburg OR Tambo as it is the same when it was Jan Smuts airport FAJS.  I think another one is ROV - Rostov on Don in Russia which is now URRP instead of URRR as it is a new airport  but retains the old IATA code.

With a bit of work I think i will get close to 100% of the records matched.   This means that for any combination of VAM hubs that use the Airport table that i generate from Navigraph I can automatically generate a good number of routes for each Hub

It is good to use my computer skills to get VAM data rather than typing them all in.

One of the stages I need to do is build a new FLEET TABLE from data where I can and then because I have the Aircraft ICAO in my routes data i can match that up as well.

Well enough for today for a while , I will keep you posted on how things are going