Page 1 of 2

Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 9:35 pm
by ElQuapo
I was wondering, if SI release an editor for the new EHM at some time, should we think about creating a completely new database from scratch?

I have been playing around a bit with the TBL database, and while I appreciate all the very good work that has gone into it, I think it is clearly showing signs of being based off an almost 10-year-old database.

I have mostly been looking at the danish stuff because that is where I have most knowledge, but I assume the same is probably the case for many nations. There are literally hundreds of players who have either long retired or have (as far as I know) never existed (probably leftovers from the faked database from EHM2007 that is the base of the current database). Many new players are obviously missing. The same goes with clubs, player histories, nationalteam caps etc. etc.

Would it be easier to choose a starting date (for example the beginning of next season) and create a whole new database that is accurate for that date, than to locate and fix all errors in the current one?

Just wondering :-)

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 9:46 pm
by archibalduk
I see where you're coming from, but I think it's just too much work. Just re-doing all of the player career histories would be a massive task alone. It would also diminish the pool of free agents we have in the database.

The Danish leagues have been neglected because we've had no volunteers (but we very recently got a volunteer which is great!). I remember when I first took on the UK leagues a few years back; the rosters particularly in the lower leagues hadn't been updated for years. It took some time to get things up to date, but it wasn't all that bad. Especially now that much of the editing work can be done via spreadsheets.

Hopefully now with the massively increased number of researcher volunteers, we can get more leagues in good shape - and tidy up all of those players that should have been retired years ago.

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 9:49 pm
by Manimal
Well, we could just copy-paste the stuff we need into a blank db.
However, when 15-16 season starts we might have a full version of the game and SI running things completely and they might have something up their sleeve. Who knows?

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 9:50 pm
by mpronger
Wouldn't the best option be to unfake the official EHM EA 2014 db, like was done in 2007?

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 9:52 pm
by archibalduk
mpronger wrote:Wouldn't the best option be to unfake the official EHM EA 2014 db, like was done in 2007?
That's effectively what the TBL Rosters are. The faked database included with the game is no different to the TBL Rosters.

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 9:53 pm
by Peter_Doherty
Best option is probably to delay this question until we know if SI will proceed with full force or not, if they will then they will have all the proper licences and will make a DB from scratch i assume...

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 9:56 pm
by archibalduk
Manimal wrote:Well, we could just copy-paste the stuff we need into a blank db.
That's true! Although I think it would be quicker and easier to simply delete all of the Danish-league players from the DB and then recreate them all from scratch.
Peter_Doherty wrote:Best option is probably to delay this question until we know if SI will proceed with full force or not, if they will then they will have all the proper licences and will make a DB from scratch i assume...
Very true. :thup: And I think we're (especially Manimal) all so busy trying to manage the research team that we won't have the time to plan for such a project right now.

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 9:58 pm
by ElQuapo
Regarding histories, perhaps we could get permission from Eliteprospects.com to use their data. A script could perhaps be created that just dumps all histories directly from their site into the database.

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 10:00 pm
by archibalduk
ElQuapo wrote:Regarding histories, perhaps we could get permission from Eliteprospects.com to use their data. A script could perhaps be created that just dumps all histories directly from their site into the database.
There certainly wouldn't be any harm asking regardless. It'd be a huge help either way. :thup:

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 10:01 pm
by Manimal
archibalduk wrote:
Manimal wrote:Well, we could just copy-paste the stuff we need into a blank db.
That's true! Although I think it would be quicker and easier to simply delete all of the Danish-league players from the DB and then recreate them all from scratch.
Yeah, I kind of took for granted that we'd have the research already done now that we have a researcher for the (not-so-heavy)Metal Ligaen

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 10:30 pm
by mpronger
archibalduk wrote:
mpronger wrote:Wouldn't the best option be to unfake the official EHM EA 2014 db, like was done in 2007?
That's effectively what the TBL Rosters are. The faked database included with the game is no different to the TBL Rosters.
Yes, but the TBL rosters are unfaked from the original EHM 2007 rosters.

What I mean is to unfake the current EHM EA rosters

Re: Should we create a new database from scratch?

Posted: Thu Apr 09, 2015 11:17 pm
by pjfoster13
archibalduk wrote:
ElQuapo wrote:Regarding histories, perhaps we could get permission from Eliteprospects.com to use their data. A script could perhaps be created that just dumps all histories directly from their site into the database.
There certainly wouldn't be any harm asking regardless. It'd be a huge help either way. :thup:
Love this idea. It would be tremendous for SI to take the initiative to reach out and collaborate with such a comprehensive resource. Combining the dynamic elements of their FM engine with the TBL pro & euro database alongside Eliteprospects' college, junior, and sub-junior databases would streamline the entire player pool from top-to-bottom and could really fuel the replay-ability of a standalone game as well as a year-over-year franchise. Would also make your groups some extra money too :joy: Hoping this idea can really get pushed from your end

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 12:19 am
by batdad
mpronger-the current faked db in EHM EA IS just a scrambled version of the imported TBL DB. SI Did not do any extra database research to my knowledge.

I could see starting all over again on the database but that is disregarding a tremendous amount of work from so few guys. Alot of people went away and now are back asking for all new stuff. Sorry...but these guys were loyal and worked their tails off for nothing. I would not disregard their work. Maybe in leagues where nothing has been done because the researcher quit helping out whenever it was they did.....that person suggesting a new start could do the whole darn thing???

Too much work to do for free IMHO. Would never even think of asking that the work be disregarded and am quite disturbed that it has been. How about maybe just stepping back into the fold El Quapo and maybe researching the league you are so concerned about.

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 12:32 am
by ElQuapo
My suggestion is not to be seen as a critic of the work people have done on the TBL database. I am very grateful to the people have kept the game going and played a part in EHM coming back.

I am just suggesting that it might be easier than fixing a database which - even with all the good work that has been put into it - shows signs of its age.

Starting from scratch we would be absolutely sure that there was no fake stuff left in the database (players, arenas etc.).

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 12:34 am
by batdad
Maybe it would be,. You should try it out and let us know. :-D

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 12:38 am
by ElQuapo
batdad wrote:Maybe it would be,. You should try it out and let us know. :-D
If an editor is released I would be happy to help as much as possible. Unfortunately I don't have as much time on my hands as when EHM2007 came out, as I was a student back then :-)

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 12:41 am
by nino33
Maybe it's because I don't follow soccer/football and I've never played FM, but I was certainly thinking "smaller" than some of the ideas I've seen...I didn't imagine SI was going to spend a bunch of money on rosters; is that what they do for FM? Seems OOTP/FHM is volunteers (as was EHM previously).

I've thought all along it'd be great if the updated EHM07 a bit, and in the process made more editable - and that's pretty much where I still am. I see we're going to get months of development, and updates/fixes every two weeks! And I see reference to "better support for customisation in the future" (i.e. better editability!)

If it goes better than the above, excellent! Fantastic! Tremendous!...but I'll be happy with the above



Regarding databases, as a researcher...can you give us more than 2 weeks! :-D

I've been actively involved helping with the TBL Rosters the last four years, and we've never had even close to enough researchers! I would have preferred to focus exclusively on retro database editing, but I see the value in modern rosters and wanted to support those few that were doing the editing. This has meant the last two years I did all of Major Junior! Just to update the players/staff and look at CA/PA and Offensive/Defensive role for the 60 teams took me 4-5 months.

Yes we've had an influx of researcher help, but we only just discovered there's a new EHM 2 weeks (or less) ago! Can we please have a couple/few months to get things addressed/improved

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 12:43 am
by nino33
ElQuapo wrote:If an editor is released I would be happy to help as much as possible.
There are editors. The editing is done with an EHM07 database (so the old Pregame Editor and the new Updater can both still be used), which is then imported into EHM:EA

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 12:44 am
by Peter_Doherty
I would love to help in some capacity, just find me something to do and i'll do it to the best of my ability :)

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 12:46 am
by ElQuapo
nino33 wrote:
ElQuapo wrote:If an editor is released I would be happy to help as much as possible.
There are editors. The editing is done with an EHM07 database (so the old Pregame Editor and the new Updater can both still be used), which is then imported into EHM:EA
Yes, but we are still basically working with a 10 year old database that started out as a faked one.

Starting from an empty database would remove a lot of waste and leftover stuff from the last 10 years :-)

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 1:04 am
by batdad
Leftover and waste like what? Not sure what you mean by that. The guys have done a ridiculous job of clearing out leftover and waste IMHO

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 1:12 am
by nino33
ElQuapo wrote:we are still basically working with a 10 year old database that started out as a faked one.
Starting from an empty database would remove a lot of waste and leftover stuff from the last 10 years
We're not starting with a 10 year old database. Maybe with the Danish League nothing/not much has changed in years (we never had a Danish researcher!), but the players/teams/affiliations/staff/arenas/budgets/etc. have been updated on an ongoing basis for many, many Leagues.


FYI - If you wanted to start with an empty database, there is a blank database available http://www.ehmtheblueline.com/forums/vi ... k+database

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 12:04 pm
by Koekenbakker
Peter_Doherty wrote:I would love to help in some capacity, just find me something to do and i'll do it to the best of my ability :)
You can count me in, but I don't have a lot of knowledge besides the NHL since I have no time (and facilities) to follow other leagues.

If we can get histories from Eliteprospects I'd be willing to write a function or so to import them. I don't think it will be that hard to do IF (and this is a prequisite) we can either get a copy of their DB on the backend or can connect our import function to their webfunction (probably php/mysql thingy).

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 6:13 pm
by Manimal
Peter_Doherty wrote:I would love to help in some capacity, just find me something to do and i'll do it to the best of my ability :)
I've got something for you. Will PM soon.

Re: Should we create a new database from scratch?

Posted: Fri Apr 10, 2015 7:00 pm
by Peter_Doherty
Manimal wrote:
Peter_Doherty wrote:I would love to help in some capacity, just find me something to do and i'll do it to the best of my ability :)
I've got something for you. Will PM soon.
Aight, nice :)