12-22-2013, 04:16 PM | #1 | ||
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
FOF7 - Exported Data -What should be added, changed, fixed?
Issues/Concerns
- Team Schedules – Pre-Season and Regular Season games do not show up until played - Player Information – ‘Chosen Team’ links to Team_Id ‘0’ by default. Should be ‘99’ or something else until determined since Team_id = Arizona - College_id, hometown_id, and state_id information cannot be mapped to a name because name tables don’t exist - Rookies.csv does not include the Base Grade info Suggestions/Request - Display all stage/week information as integers instead of a character variables - Please add Global Future Ratings (green bars), if there is a feasible/logical way Last edited by Dutch : 03-15-2014 at 09:46 AM. |
||
12-23-2013, 06:13 AM | #2 |
Morgado's Favorite Forum Fascist
Join Date: Oct 2000
Location: Greensboro, NC
|
Is anyone esle finding that there's a space at the beginning of text fields in the export? Is this just an Excel issue?
__________________
The media don't understand the kinds of problems and pressures 54 million come wit'! |
12-23-2013, 06:15 AM | #3 |
Morgado's Favorite Forum Fascist
Join Date: Oct 2000
Location: Greensboro, NC
|
Hmmm..yeah...there's a space there in the raw file. Any ideas on how to deal with this easily?
Player_ID, Last_Name, First_Name, Junior_Flag, Nickname, Position, Player_of_Game_Count, Championship_Rings, Player_of_the_Week_Count, Height, Weight, Hall_of_Fame_Flag, Year_Inducted, Percentage_of_Vote, Chosen_Team, Year_Born, Month_Born, Day_Born, College, Draft_Round, Drafted_Position, Drafted_By,Draft_Year, 4th_Quarter_Comebacks, Quarterback_Wins, Losses, Ties, Home_Town, Home_State, Career_Games_Played, Number_of_Seasons, Season_1_Pointer_to_Player_Year_Data, SP_2, SP_3, SP_4, SP_5, SP_6, SP_7, SP_8, SP_9, SP_10, SP_11, SP_12, SP_13, SP_14, SP_15, SP_16, SP_17, SP_18, SP_19, SP_20, Season_1_Year, SY_2, SY_3, SY_4, SY_5, SY_6, SY_7, SY_8, SY_9, SY_10, SY_11, SY_12, SY_13, SY_14, SY_15, SY_16, SY_17, SY_18, SY_19, SY_20 1, Flynn, Nate, 0, , K, 0, 0, 0, 69, 183, 0, 0, 0, 0, 1978, 7, 20, 153, 28, 6, 30, 2013, 0, 0, 0, 0, 11434, 42, 0, 0, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 2, Chase, Paxton, 0, , P, 0, 0, 0, 74, 217, 0, 0, 0, 0, 1981, 10, 23, 21, 36, 20, 16, 2013, 0, 0, 0, 0, 13409, 49, 0, 0, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, -1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
__________________
The media don't understand the kinds of problems and pressures 54 million come wit'! |
12-23-2013, 08:09 AM | #4 | |
High School JV
Join Date: Sep 2002
Location: GA
|
Quote:
If you are web programming then in php you can run a trim() function to trim off leading and trailing whitespace. |
|
12-25-2013, 10:08 PM | #5 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
I'm not sure if this is the right place or not, but I'd like to throw out ideas as I get them here for the exported data. Please let me know if there is a better avenue to articulate these things.
New Field requests... team_information.conf_id(INT) team_information.div_id(INT) team_information.nickname(VARCHAR) team_information.owner_name(VARCHAR) Last edited by Dutch : 12-25-2013 at 10:16 PM. |
12-25-2013, 10:16 PM | #6 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
Would it make sense to split the 'universe_info' table? Personally, I'm not very good at deciphering the best way to implement that information as it is.
However, something like this would be very helpful to me. 'game_stage' {stage_id(INT), stage_title(VARCHAR), current_year(INT)} 'current_game_info' {salary_cap(INT), min_salary(INT)} 'draft_order' {round(INT), position(INT), orig_team(INT), cur_team(INT)} Last edited by Dutch : 12-25-2013 at 10:16 PM. |
12-26-2013, 01:12 PM | #7 |
Morgado's Favorite Forum Fascist
Join Date: Oct 2000
Location: Greensboro, NC
|
PoW mentions is there, but PoW wins is not.
__________________
The media don't understand the kinds of problems and pressures 54 million come wit'! |
12-27-2013, 03:58 PM | #8 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
Here is a list of all the stages in FOF7. This will help with updated web-sites. The current stage is identified in the 'universe_info' stage.
stage_id stage_name 1 Pre-Staff Draft 2 Staff Draft 3 Pre-Free Agency 4 FA Stage 1 5 FA Stage 2 6 FA Stage 3 7 FA Stage 4 8 FA Stage 5 9 FA Stage 6 10 FA Stage 7 11 FA Stage 8 12 FA Stage 9 13 FA Stage 10 14 FA Stage 11 15 FA Stage 12 16 Amateur Draft 17 Pre-Late FA Period 18 Late FA Stage 1 19 Late FA Stage 2 20 Late FA Stage 3 21 Late FA Stage 4 22 Late FA Stage 5 23 Pre-Training Camp 24 Ex. Season Week 1 25 Ex. Season Week 2 26 Ex. Season Week 3 27 Ex. Season Week 4 28 Ex. Season Week 5 29 Reg. Season Week 1 30 Reg. Season Week 2 31 Reg. Season Week 3 32 Reg. Season Week 4 33 Reg. Season Week 5 34 Reg. Season Week 6 35 Reg. Season Week 7 36 Reg. Season Week 8 37 Reg. Season Week 9 38 Reg. Season Week 10 39 Reg. Season Week 11 40 Reg. Season Week 12 41 Reg. Season Week 13 42 Reg. Season Week 14 43 Reg. Season Week 15 44 Reg. Season Week 16 45 Reg. Season Week 17 46 Wild Card Round 47 Divisional Round 48 Conference Round 49 Front Office Bowl 50 End of Season Last edited by Dutch : 07-18-2014 at 12:26 AM. |
12-28-2013, 06:53 PM | #9 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
I've created a single 'player_ratings' database that I will need to import 'player_ratings_season_yyyy' csv's into.
A 'master_record' field that is null would be a nice addition to the 'player_ratings_season_yyyy' files. That way our db's can have a primary_key that auto-increments. Adding a 'year' column would be a plus. |
12-29-2013, 09:50 AM | #10 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
I don't see team schedules in the exported data...just the completed games. Am I missing that?
|
12-29-2013, 09:51 AM | #11 |
Morgado's Favorite Forum Fascist
Join Date: Oct 2000
Location: Greensboro, NC
|
Schedules are not there.
__________________
The media don't understand the kinds of problems and pressures 54 million come wit'! |
12-29-2013, 11:56 AM | #12 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
Ok, thanks for verifying.
|
12-29-2013, 01:04 PM | #14 |
Morgado's Favorite Forum Fascist
Join Date: Oct 2000
Location: Greensboro, NC
|
No. Schedule results are there. If we could just have the rest of the games--with zeros for results--of the current year included in the one csv, that would be fine (and easier.)
__________________
The media don't understand the kinds of problems and pressures 54 million come wit'! Last edited by Ben E Lou : 12-29-2013 at 01:04 PM. |
12-29-2013, 01:08 PM | #16 | |
High School JV
Join Date: Sep 2002
Location: GA
|
You don't need a blank field in the csv to have a primary key in the DB that auto-increments. Unless I'm missing something you can just have the field in the DB and when you insert a record the key will be populated on its own.
Quote:
|
|
12-29-2013, 01:13 PM | #17 |
Morgado's Favorite Forum Fascist
Join Date: Oct 2000
Location: Greensboro, NC
|
game_information has results for every game in the league's history with a "year" column. Add the unplayed games for the current season to that list, and that's all that's needed.
__________________
The media don't understand the kinds of problems and pressures 54 million come wit'! |
12-29-2013, 01:44 PM | #18 | |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
Quote:
I was getting an error when importing because I created a 'master_record' column in the table. So I had to add an extra column into the yearly record. I was concerned about duplicate records, but I suppose I could just as easily make a key based on record and year. |
|
12-29-2013, 07:23 PM | #19 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
I decided to add a master_record because I kept getting an error with duplicate entries...and with a few of the player_season csv's having corrupt data, it was just easier to make the master_record.
|
12-29-2013, 08:22 PM | #20 |
High School JV
Join Date: Sep 2002
Location: GA
|
I don't believe the QB Formations attribute is exported in the ratings. I'm having to backfill it with 0s for now in Conscriptor.
|
12-31-2013, 01:46 AM | #21 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
I've consolidated all notes. I plan to send this info to Jim/Ben on wed. If you have anything, please post it here.
|
01-01-2014, 05:10 PM | #22 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
All issues/suggestions raised here have been sent to Solecismic's e-mail support e-mail.
|
01-07-2014, 07:13 PM | #23 |
Pro Starter
Join Date: Oct 2000
Location: Cary, NC
|
If I were to revive Draft Analyzer, it would want:
- Formation information for QBs - Birthdates (for potential affinity / conflict reporting) - Bar min/maxes in the rookie player CSV. I have to double-check, it would be good for the player id to be in there as well (we could then hook all that up so we had correct rookie combines for everyone, and Ben wouldn't have to rename rookies to avoid duplicate names...)
__________________
-- Greg -- Author of various FOF utilities |
01-07-2014, 08:06 PM | #24 | |
High School JV
Join Date: Sep 2002
Location: GA
|
Quote:
for Conscriptor Though the rookie bar min/maxes are team specific right, just like current players? Perhaps a player_opinion or rookie_opinion file for the bar values matched to player_id to separate out what is fact and opinion of your scouts. |
|
01-25-2014, 11:46 AM | #25 | |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
Quote:
Formations for active quarterbacks were added. PlayerID was added to rookies so we can link to birthdates. |
|
02-19-2014, 10:20 PM | #26 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
Player_information.csv has (what I assume is) an error where 'chosen_team' defaults to teamid 0 when a team hasn't actually been chosen for that player. (I believe this is only set when a player is inducted to the Hall Of Fame)
Last edited by Dutch : 02-19-2014 at 10:32 PM. |
02-19-2014, 10:31 PM | #27 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
Columns that identify a college, hometown, or state by an integer don't have a relationship to their respective names.
|
02-20-2014, 07:49 PM | #28 |
High School JV
Join Date: Sep 2002
Location: GA
|
|
02-20-2014, 11:26 PM | #29 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
I tried to use the old college name table but the FOF2k7 had ~600 names and FOF7 has ~700 id's...so it doesn't match up.
|
02-24-2014, 08:53 PM | #30 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
The use of a variable in the 'week' column in game_information is frustrating to say the least.
I've built a stage_info table to help ease the pain (as I've mentioned here before) and really wish this could somehow be incorporated into the export data. For instance, I am trying to show last week's game results. My counter shows that today is "Ex. Season Week 3" and I would like to show the last stage results which is "Ex. Season Week 2". In my stage_info table, "Ex. Season Week 3" is stage_id 25...and "Ex. Season Week 2" is stage_id 24....so I need a way to join the tables so I can say, (stage_info=stage_info 25 - 1). I wish that game_information would have the 48 stages of the game identified by integer so I could do this without additional (and slow...) JOIN statements. Last edited by Dutch : 02-24-2014 at 08:54 PM. |
02-27-2014, 06:06 AM | #31 | |
College Prospect
Join Date: Sep 2010
|
Quote:
I see this information still isn't there. The bold seems like extremely critical information. If I'm not mistaken, this is nowhere to be found in export data. What are your guys' solution to this? Are there more data format changes forthcoming, or is this what we're likely stuck with (for better or for worse) for FOF7? Forgive me, I'm out of the loop. (edit: I suppose you can pull division, as a text string, from 'standings', but this doesn't include conference and SELECT division FROM team_info, standings where team=team is not a very nice solution.) Last edited by aston217 : 02-27-2014 at 06:13 AM. |
|
02-27-2014, 01:18 PM | #32 |
Morgado's Favorite Forum Fascist
Join Date: Oct 2000
Location: Greensboro, NC
|
team_information.csv is a *completely* different file--with the same file name--after the season rollover. Not sure yet if that's true for the entire offseason, or just this one stage. In the season, it's similar to fof_teams. But the one I just exported (right after the season rollover) closely mirrors fof_franchise.
__________________
The media don't understand the kinds of problems and pressures 54 million come wit'! |
02-27-2014, 03:07 PM | #33 | |
Morgado's Favorite Forum Fascist
Join Date: Oct 2000
Location: Greensboro, NC
|
Quote:
Team Playoff_Performance Average_Attendance Percent_of_Capacity_(of_1000) TV_Contract_(all_money_is_in_thousands) Ticket_Revenue Suite_Revenue Salary_Cost Bonuses Concessions Parking Advertising Staff_Cost Maintenance Stadium_Payments Overall_Performance Franchise_Value Profit Season_Tickets_Sold Capacity Top_Quarterback Top_Rusher Top_Receiver Top_Tackler Coach Quarterback_Passing_Yardage Rusher_Yardage Receiver_Yardage Tackles No idea how it did it. My best guess is that perhaps there are two files being written in the export routine with the same name, causing one to overwrite the other, which would be why we've never seen the fields I pasted above. But maybe I happened to open the first team_information.csv before the routine had finished, thus preventing the second one from overwriting it.
__________________
The media don't understand the kinds of problems and pressures 54 million come wit'! |
|
02-27-2014, 06:27 PM | #34 |
Pro Starter
Join Date: Oct 2000
Location: Cary, NC
|
Process Monitor - will tell you what file operations happen (notably opens/closes) and could confirm your theory.
__________________
-- Greg -- Author of various FOF utilities |
03-06-2014, 08:57 PM | #35 |
College Prospect
Join Date: Sep 2010
|
Can anyone confirm for me that they're seeing the same thing?
the first transactions file of the league has this structure: Code:
Subsequent ones... Code:
Or is it just me?... |
03-09-2014, 11:35 AM | #36 | |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
Quote:
Please, Jim, please! This is all we can do in the meantime for our schedule pages... Team Roster Last edited by Dutch : 03-09-2014 at 11:55 AM. |
|
03-09-2014, 11:36 AM | #37 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
|
03-09-2014, 11:36 AM | #38 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
|
03-09-2014, 11:40 AM | #39 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
Oh, and while we are at it, I'm having a lot of beautiful pages looking rather red since we lost the individual bar futures...
They will all look like this now... RNFL Would love to re-add those green bars underneath to get that nice FOF look. I've got all that code commented out and it's ready...just need the data. Last edited by Dutch : 03-09-2014 at 11:40 AM. |
03-10-2014, 08:40 AM | #41 | |
Pro Starter
Join Date: Oct 2000
Location: Cary, NC
|
Quote:
The first one doesn't have trades or position switches. In 2k7, the format of individual transactions varied widely depending on the actual transaction itself.
__________________
-- Greg -- Author of various FOF utilities |
|
03-12-2014, 03:23 PM | #42 |
College Prospect
Join Date: Sep 2010
|
Thanks, greg.
in team_statistics.csv, there's a column for "sacks" and one for "sack_yardage". Does anybody happen to know if that's times sacked and sacked yardage? I'm assuming it is, because the sack yardage usually only comes up elsewhere in the CSV when we're talking about how many yards a QB was sacked for. |
03-12-2014, 04:14 PM | #43 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
Aston,
Assuming I understand your question, the 'Sacks' and 'Sack_yardage' fields are dependent upon the 'unit' field. Each team has two entries, one for offense and one for defense. So to answer your question it does stand for "How many times your QB's were sacked and how many yards they were sacked for", but only when unit='offense'. |
03-12-2014, 04:30 PM | #45 |
High School Varsity
Join Date: Feb 2008
Location: Southern Maryland - For Now!
|
It would be beyond sweet if Jim were to incorporate some of the work you guys are doing into the game. It's just a natural extension of the capability he has buried within his code.
|
03-12-2014, 04:44 PM | #46 |
College Prospect
Join Date: Sep 2010
|
Okay, now I'm confused again.
I had convinced myself that 'offense' and 'defense' translated to 'team' and 'opponent', since for the in-game stats, that switched between the two sets of stats for each team. Take for example, the row where team_id = 3, unit = defense. Let's say this row has the following data: rush attempts: 400 hurries: 80 kick returns: 60 penalties: 100 (1) 'unit=defense' actually means 'opponents of team id=3', so opponents made 400 rush attempts on Team 3, recorded 80 hurries on Team 3, 60 returns against Team 3, and 100 penalties against Team 3. (2) 'unit=defense' literally means 'team id=3 defense', so Team 3's defense faced 400 rush attempts (same), but recorded 80 hurries against opponents (opposite). And kick returns would mean....? But especially, penalties would mean, what? I hope it's not (2). That seems harder to work with. In (1) all of a team's stats are in one row, and all of the opponents' stats are in the other row. In (2) each row, offense and defense, has a mixture of 'team stats' and 'opponent stats'. Last edited by aston217 : 03-12-2014 at 05:01 PM. |
03-12-2014, 06:06 PM | #47 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
You're confusing me, now.
Let's take the New York Giants (NYG) and your data. Offense - NYG rushed 400 times Offense - NYG QB's were hurried 80 times Offense - NYG returned 80 kicks Offense - NYG had 80 penalties Defense - NYG had 400 rushes against Defense - NYG had 80 QB hurries Defense - NYG had 80 kicks returned against Defense - NYG had 80 penalties Not sure if that helps but that's what I would expect it to mean. |
03-12-2014, 06:26 PM | #48 |
College Prospect
Join Date: Sep 2010
|
Right, so what confused me was whether "unit: offense/defense" literally means offense/defense, or whether "unit: offense/defense" actually means "stats by this team / stats against this team."
Because your explanation makes sense based on the unit names, BUT Firefly just provided me with the CFL's export data and I tracked down the two rows for my team from last season: year 2034, team GBY, unit offense 18 "sacked", 100 "hurries" year 2034, team GBY, unit defense 34 "sacked", 66 "hurries" I know and can look up that Green Bay's defense recorded 100 hurries and 34 sacks. So it seems offense actually means "by the team" and defense means "against the team". (Side note: I really wish it would be 'sacks' instead of 'sacked' now...) For what it's worth, while we're here, "RB rushes" and "RB rushing yards" apply only to the "offense" unit; 0's are recorded under 'defense.' You know, we should collectively set about documenting this whole darn thing Last edited by aston217 : 03-12-2014 at 06:30 PM. |
03-12-2014, 07:15 PM | #49 |
"Dutch"
Join Date: Oct 2000
Location: Tampa, FL
|
How do these numbers line up against the Team Statistics in FOF7, does it all match, at least?
Last edited by Dutch : 03-12-2014 at 07:16 PM. |
03-12-2014, 07:19 PM | #50 | |
College Prospect
Join Date: Sep 2010
|
Hm? These two rows are from FOF7 export data's team_statistics.csv, if that's what you are asking?
Quote:
I mean, the stats were recorded during a 2k7 season, but the league has converted now. Last edited by aston217 : 03-12-2014 at 07:20 PM. |
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Thread Tools | |
|
|