EHM The Blue Line

FYI – I’m many weeks away from an updated release, maybe a couple months (I’ve been enjoying some time off but I’m back to work on Monday!)

I am quite pleased with how things have been going…I’ve deleted ALL non-historical players/staff, and added complete player history for hundreds of players (about half the NHL and about a third of the AHL/CHL are done), and I’ve been creating the required new_staff files needed to add historical players and staff to the EU/Russia

I’d already started, comparing hockeydb data with eliteprospects data and creating new_staff files, with (so far) 22 new players to add to the Russian Elite League and 103 new players to add to the Czech Elite League…over the last week I’ve been using the research of SharksAttack too as I’ve been working on Finish players/staff, and I’ll be done the Finish Elite League this weekend (259 more historical players/staff!).....my intentions are to then move on to the Swedish Elite League before returning to work on the Russian/Czech Elite Leagues (and I want to add NCAA players/staff too)


Regards

Wow, this is turning into a full-blown Euro update.

archibalduk wrote:Wow, this is turning into a full-blown Euro update.

Yep!

I love the fact that most of my efforts are "transferable" and I'm hoping in the future I'll be able to have a 1974 database that works more the way I'd like it to (i.e. more historically accurate)...I'm still hoping for something that would allow for the creation of the 1974 database in EHM05, and for sure FHM may well provide me with the best opportunity for the 1974 database of my dreams (depending on how good the gameplay turns out to be, and how editable it is)

nino33 wrote:January 4th – I’m many weeks away from an updated release, maybe a couple months

FYI - It's going to be months

I'm going to again take another break from 1974 database editing.
I suspect it'll be March/April before there's an updated version available (maybe longer)...but there will be an update!


Regards

nino33 wrote:JAN 17 - I'm going to again take another break from 1974 database editing.

Turns out the break was short.....I'm back working on the 1974 database!



I'm currently fixing history errors/issues that occurred when I inputted XenHL's work.
I had actually already added only NHL/WHA history for just the NHL players (last summer IIRC)...unfortunately I noticed only after I'd inputted all her work that XenHL had not accounted for the work already done, so now I have many players with duplicate NHL/WHA history entries.

I've exported all the history entries and I'm currently going through and deleting the duplicates.
I'm then going to blank out all history in the database, and then I'll import the corrected history.

I'll need to figure out how to blank out (delete) all history...
I tried one suggested way (http://www.ehmtheblueline.com/forums/vi ... ry#p143468) but it didn't work...I got an error message (v3.0.4 select_leagues_screen.cpp85) and crash at start-up.



I've also been continuing my work creating historical players/staff for Sweden, Finland, Russia and the Czech Republic/Slovakia (last night I was working on adding Swedish players while watching the 1976 USSR/CSSR Canada Cup game!)

Load the EHM Updater and select option #10 (Staff career history validation). This will remove all duplicate entries. A duplicate entry is regarded as two entries will identical stats for the following: Staff, year, team, competition, regular season/playoffs, games played.

All duplicate data that is deleted is exported to: staff_history_errors.csv

All data which appears suspicious (i.e. it appears that it might be duplicate, but doesn't quite fulfill the criteria for being regarded as duplicate) is not deleted, but exported to: staff_history_warnings.csv

Alas not all the data is the same.

Ages ago when I did my history work, I used the 1974-75 NHL team for any "missing from the database (at that time) team" for entered history, and I'd also attributed WHA history to the NHL in some cases (it's hard to remember details, but I do know at least some things are messed up).....but by the time I imported XenHL's work dozens of missing teams/leagues had been added, and XenHL's work corrected mine (i.e. attributed WHA history correctly)

So the teams/leagues can be different! i.e. John Garrett's duplicate data shows for the NHL-North Stars (what I entered last year before I'd added missing teams) and also for the WHA-Fighting Saints (what XenHL's correct data shows). And XenHL's goalie data often included saves when mine did not!
Data for some forwards/defensemen will show as an NHL team and it'll show as the correct WHA team too (so both league and team will be different).

And also when I did the original data (with your first History Updater, before the EHM Updater) there was no "blank" option and it seems the Roanoke Valley Rebels was used (and I never did get to fixing this).

So I'm totally OK with going through the 15 files XenHL prepared and correcting things (the minor league/major junior history is 100% fine as is; it's only NHL/WHA history that is duplicated).....but I will need to figure out again how to blank/delete all player history (I did it before to get rid of the modern history, so I'm confident I can)

I used the Updater function #10 and removed 1048 exact duplicates! Thanks Arch!

I only got 33 warnings, and they don't seem to connect to the "same stats but different team/league" issue...

I'm going to poke around some and see what's still in need of fixing...

I found some exact duplicate entries that didn't get deleted, and so I used function #10 6 times in total before getting "0" entries deleted!

1st time (noted above) - 1048 deletes, 33 warnings
2nd time - 476 deletes, 20 warnings
3rd time - 187 deletes, 19 warnings
4th time - 106 deletes, 18 warnings
5th time - 11 deletes, 13 warnings
6th time - 0 deletes, 20 warnings

I did nothing to the database between each time I ran function #10 - just renamed the database, deleted the previous deletes/warnings csvs, and ran function #10 again

I haven't looked at the details, just kept running function #10 until it showed 0 deletes...


EDIT - I've found exact duplicates that were not previously deleted

Yeah unfortunately the algorithm isn't 100% perfect. Thankfully it gets the vast majority of them on the first pass.

Let me know once you've gotten your history spreadsheet all ready to import and I'll give you a hand. I have a feeling that the Updater doesn't create a new history file from scratch any more - I think I inadvertently broke it when I improved some error checking functions.

We'll see whether I keep it up, but currently I'm reviewing what's left manually (looking at an exported_staff_history file, and once I find errors/duplicates I'm deleting them immediately using the PreGame Editor)...as it's just NHL/WHA stats that might be duplicated, and even all "blank team errors" show as one team (Roanoke Valley Rebels), it's not to hard to focus my efforts (at least that's what I'm thinking right now! HaHa)

nino33 wrote:We'll see whether I keep it up, but currently I'm reviewing what's left manually

It's working (reviewing what's left manually). It'll take a few days, but it's worth it.
There are 4579 history entries I need to review, and so far I've gone through 1096 (making corrrections/deletions as required)

nino33 wrote:JAN 4 - I’ll be done the Finish Elite League this weekend (259 more historical players/staff!).....my intentions are to then move on to the Swedish Elite League before returning to work on the Russian/Czech Elite Leagues (and I want to add NCAA players/staff too)

Swedish Elite League is almost done! Currently 191 more historical players/staff to add!

Re: the duplication of NHL stat-entries - it's probably because I didn't delete the existing ones from the spreadsheets I made?

Uh, to be clearer, my process was like this:

In the pre-game editor, find all players contracted to a given team, and write them down on paper; repeat for a second team (I did two teams at a time).

Then, using that list as a reference, I'd go through the exported history stuff to find the players on those lists, and put them into a new spreadsheet with their existing history data. Any players not already there were added to the list.

I then went through each player's history data. NHL entries I mostly just scanned over, not really looking at closely (except in cases of goalies, I did try to find save info where possible). WHA entries - being aware of the Roanoke Valley Rebels issue - I looked at more closely, and did make corrections there. For other leagues, it was just a matter of finding and entering the information.

When all the players were done, save, send to Nino.

I'm really sorry if I caused you extra work!

Good to "hear your voice again" Xen!

XenHL wrote:Re: the duplication of NHL stat-entries - it's probably because I didn't delete the existing ones from the spreadsheets I made?

Yes

XenHL wrote:I'm really sorry if I caused you extra work!

No worries! Overall you saved me an ENORMOUS amount of work!

nino33 wrote:JAN 17 - I'm going to again take another break from 1974 database editing.
JAN 27 - Turns out the break was short.....I'm back working on the 1974 database!

FYI - I worked on the 1974 db for another week, and then returned to work on prepping to help with the re-rating of the NHL for the TBL Rosters. I will be returning to work on the 1974 db in March; I get the last week of March off (school Spring Break), and I suspect if version 2 of the 1974 db is not already out by then it will be by the start of April!

An updated/improved 1974 database will be released soon!
Not sure how soon it’ll be, or even if it’ll be in April for sure…haven’t decided yet

After spending most of my time in recent months NOT working on the 1974 database, I’ve returned to working on it this week (during my Spring Break week off). Previously LOTS was done September-January, and work has continued in spurts since…and now I’ve been getting lots done this week!


1974 db improvements (since last September's release of version 1)
- All "modern" players and staff have been deleted! (the game does seem to create staff at start-up)
- I've added the Draft info/NHL Rights and edited the PAs for all 500+ AHL players; review/editing of 300+ CHL players in-progress
- I've added 400+ more players and 100+ Staff to Major Junior
- With XenHL's help I've added complete player history for approx 17 minor pro teams
- With XenHL's help I've added the non-NHL player history for the players for about 15 NHL teams.
- I'm currently in the process of adding hundreds of historical European/Russian players!

This week I've added 200+ historical Finns, and 200+ historical Swedes, and I'm currently working on the Czechs/Slovaks (about 50+ added so far)

Did AHL/CHL players ever get any more attention beyond Name, rights, and PA? It was kinda' depressing to watch 50-goal guys in AAA get cut by their AAA teams because they were rated no differently than scrubs.

Primis wrote:Did AHL/CHL players ever get any more attention beyond Name, rights, and PA? It was kinda' depressing to watch 50-goal guys in AAA get cut by their AAA teams because they were rated no differently than scrubs.

Previously all AHL/CHL players had the same -5 PA (max 100), and no players had NHL contracts

Now there is a range of PAs, and as applicable NHL contracts...so it should be an improvement! "50 goal scorers" should show different/better ratings than scrubs, and shouldn't end up cut (they'd likely be contracted to a parent/NHL team now)

nino33 wrote:MAR30 - This week I've added 200+ historical Finns, and 200+ historical Swedes, and I'm currently working on the Czechs/Slovaks (about 50+ added so far)

Work is progressing very slowly; still working on adding historical Czech/Slovak players

Given the current/recent rate of progress, I'm not likely going to push out version 2 of the 1974 db anytime soon...at this point I'm just slowly plugging away adding historical Europeans/Russians


Regards



EDIT
Thanks for the feedback gambia_boy. I’m aware of the “Mario Lemieux not making it to Major Junior/Pro” issue, not sure why it’s happening though…when I get back to actually play testing I’ll be looking into it further

nino33 wrote:MAR30 - This week I've added 200+ historical Finns, and 200+ historical Swedes, and I'm currently working on the Czechs/Slovaks (about 50+ added so far)
APRIL7 - Work is progressing very slowly; still working on adding historical Czech/Slovak players. Given the current/recent rate of progress, I'm not likely going to push out version 2 of the 1974 db anytime soon...at this point I'm just slowly plugging away adding historical Europeans/Russians

CURRENT STATUS - Work has continued, I've completed adding the available historical Czech/Slovak players, and have started on historical US College players (3 teams done), and then I'll add additional historical Russian players. PLUS I'll need to further detail/edit all of these added players, AND now with Archi's Random Name Generator I'll be able to fully populate the "additional/empty" teams in Major Junior, Minor Pro, College, Elite Leagues, etc

The point is while LOTS has been done and work has continued (right up until today), there's LOTS I still want to do, but it won't be done for awhile as I'm now taking a break for a bit! - so likely an early summer release for version 2 (though for anyone interested in playtesting it and providing feedback, the database is avaialable now)

I just recieved OOTP 14 as an early birthday present, and I intend on immersing myself in the baseball world for a bit!

nino33 wrote:so likely an early summer release for version 2

Changed my plan!...given so much has been done since last September, and I'm taking a break from editing for the foreseeable future, I've decided just to release version 2.0 "as is" right now. I've sent the database to Arch and he'll add it to the downloads section when he has time.

I will return to work on the 1974 db and I will release a version 3.0 this summer.


Regards

I'll be getting this online as soon as I can tomorrow!

Here you go: http://www.ehmtheblueline.com/forums/vi ... 116&t=9915

I have also added a gallery on Facebook: https://www.facebook.com/media/set/?set ... 2760794876

FANTASTIC WORK, Nino and XenHL!!!

I just had to post the below image!! I think Schultz may have been the victor.

A bit nit-picking here, but from the screenshots, shouldn't New England have their nickname as short name?
They are the only team that doesn't