PECOTA and Phillies prospects

I’m sure most of you have heard the word “PECOTA” at some point when reading about baseball analysis and statistics. Basically, PECOTA was developed/created by Nate Silver at Baseball Prospectus. It’s basically a really complex algorithm that analyzes players in a number of advanced metrics, and the power of the system is basically that it takes just about anyone that has ever played the game and puts their data along side the players it is comparing them to, and then tries to figure out which direction the current player’s career will go, based on what has happened to similar players in the past. The system is incredibly complex, and if you haven’t ever read up on it, I’d suggest reading the wikipedia entry here before you dig into this post. While PECOTA is useful for projecting major league statistics for the upcoming season, it’s also useful to get a snapshot of which prospects the system seems to like, and which prospects the system isn’t as high on.

To do this, I’ll just use the core statistic, Upside. Here is the definition of “Upside” from BaseballProspectus.com

UPSIDE is determined by evaluating the performance of a player’s PECOTA comparables. If a comparable player turned in a performance better than league average, including both his batting and fielding performance, then twice the number of runs he contributed above average is counted toward his UPSIDE. If the player was worse than league average, or he dropped out of the database, the performance is counted as zero.

Basically, the higher the “Upside” the better the future outlook is for a player. There is no scale, it’s purely based on raw score. For example, Hanley Ramirez has the highest UPSIDE score in baseball, at 414.2, and you’ll then go to the other end of the spectrum and find a guy like Alex Cintron with an UPSIDE of 1.7. And remember, UPSIDE is tracking the general quality of a player based on what his comparable players did. So if a player is a very unique player, it will be reflected in his BETA score, and the UPSIDE won’t be as reliable. A player with a BETA of 1.0 is average in terms of the riskiness of his forecast, while players with a BETA over 1.0 are more risky, and players with a BETA of less than 1.0 are less risky. Ok, got all of that? Now, before we get into the actual nitty gritty of Phillies prospects, I wanted to post this extract from Nate Silver’s article last year, which explained how he went about analysing prospects. Basically, he made it clear that these rankings are not to take the place of scouting reports, but simply be used as another tool. That should be common sense. Just use this as another piece of information. Anyway, here is Silver’s basic explanation of how to use UPSIDE to look at prospects. Please read this before continuing.

Upside gives credit only for performance above league average at the player’s position, and zero credit for everything else. If a player winds up being a bench guy in the majors, or gets stuck at Double-A, or quits baseball to work in a lumber yard–none of these outcomes is desirable. On the other hand, the cost of employing a prospect is relatively low, both in terms of financial outlay and opportunity cost (a player can simply be left in the minors if he’s not good enough for MLB), so assigning negative points for a below-average or below-replacement level performance isn’t quite fair. Upside works around this negative value problem by giving credit for the good, while treating all different types of bad performance as having zero (but not negative) value. The version of Upside that we’re using here is the peak-adjusted variant, which measures a player’s most valuable five-year window up through and including his age 28 season (or simply his next five years of performance if he’s already age 25 or older).

I realize that all of this is a bit complicated, and I encourage you to explore the PECOTA glossary if you’re the type that likes the dirty details. But the intuition behind our methodology is fairly simple: we’re attempting to measure the degree and probability of above-average performance while the player is under the control of his parent club. This is the real fruit of the unforgiving labor of scouting and development: getting impact performances from players who are still cheap under the reserve clause, or in arbitration.

This definition is very important to keep in mind when we tell you, for example, that Dustin Pedroia is at least as valuable as Delmon Young. Young is two years younger than Pedroia, and has a more athletic profile that will likely age better into his thirties. He is probably at least a 2:1 favorite to produce more value over the course of his entire major league career. But he is not such a favorite to produce more value in the years during which he’s under club control. You can only get six years and change out of a prospect before his arbitration clock runs out, and they won’t necessarily be his best years, especially if he reaches the major leagues very young. That Delmon Young is likely to be more valuable than Dustin Pedroia when he’s 32 doesn’t matter one whit to the Red Sox or Devil Rays. Both players will be long gone from their parent systems by then, or will have had the chance to negotiate deals at market price. This is very important to understand, and it’s a point that I didn’t emphasize enough last year. I do happen to think that it’s the “right” way to value prospects, but we’ll save that discussion for another time.

Alright. So now you basically understand. And one final piece of info. This was the grouping that Silver gave to kind of put prospects into tiers

Upside Score Definition
100+ Excellent Prospect. One of the better prospects in baseball. Strong chance of long major league career, perhaps with several All-Star appearances. May have Hall of Fame potential, especially if prospect is young or has a rating of 150 or higher.

50-100 Very Good Prospect. Strong chance of a meaningful major league career, with some legitimate chance at stardom. Best-case outcomes may involve some Hall of Fame potential.

25-50 Good Prospect. Reasonable chance of a meaningful major league career, but only an outside chance at stardom.

10-25 Average Prospect. Some chance of a meaningful major league career, but more likely to end up on the major league fringe. Highly unlikely to make two or more All-Star appearances.

0-10 Marginal Prospect. Very little chance of becoming a major league regular, excluding extreme mitigating circumstances affecting the player’s statistical record.

Ok good, now that I’ve thoroughly explained Upside and you understand it, lets look at Phillies prospects. I’m going to basically stick to legit prospects, and then the guys mentioned by Upside. Not every single minor leaguer will show up, and remember, guys with less experience will tend to have lower scores, because they will have fewer comparables. I’ll give the player’s upside score, then his BETA. Remember, 1.0 is average, above 1.0 is more volatile, less than 1.0 is less volatile.

C:

Lou Marson; 31.6 Upside, 1.05 BETA [comparables = Pat Cline, Pee-Wee Lopez, Alberto Castillo, John Roskos]

Marson’s Upside of 31.6 ranks him 10th among all catching prospects. 2 of the catchers above him, Geo Soto of the Cubs and JR Towles of the Astros will both exhaust their minor league eligibility this season. All of the catchers above Marson are older, and two of them (Jose Morales and Landon Powell) are basically bordering on non-prospect status. Jeff Clement, ranked #3 behind Soto and Towles, has an Upside score of 98.7, while Josh Donaldson, #4 on the list, is only at 52.0, so you can see the sharp dropoff. Marson’s bat really only started to shine in 2007, so another solid season should improve his standing here and raise his upside score. His list of comparables isn’t very impressive, to say the least.

Jason Jaramillo; 19.0 Upside, 0.96 BETA [comparables = Josh Bard, Koyie Hill, Buck Rodgers, Sean Mulligan]

Jaramillo has a lower upside score, but a safer BETA. He ranks 24th among catching prospects in terms of Upside, but the interesting thing is his top comparable. Bard split time at C for San Diego last season and showed some late developing pop with the bat. He’s not viewed as an upper echelon catcher, but he did manage a .768 OPS last season in spacious PETCO. He didn’t really develop until his age 28 season, kind of scuffling before that while basically bouncing up and down from the minors and serving as a backup. If Jaramillo is good enough for a .760 OPS in the majors as a backup, that’s a valuable commodity to have.

1B and 3B, we have zero representation, unsurprisingly.

2B

Adrian Cardenas; 37.0 Upside, 1.02 BETA [comparables = Hank Blalock, Nate Spears, Paul Kelly, Brent Abernathy]

Cardenas comes in as the 9th highest prospect on the 2B list. A few guys at the top look to drop off this season because of eligibility (Antonelli, Patterson) so he could jump up this list, especially moving to a better hitting environment in Clearwater. The big thing here is his first comparable, Hank Blalock. Blalock’s career has sputtered a bit due to injury, but he burst onto the scene as a 22 year old in 2003, posting an .872 OPS in the big leagues in 567 AB. Cardenas seems to have the pure hitting ability, the power is the only real question mark, in addition to where he settles in defensively.

Brad Harman; 23.1 Upside, 1.08 BETA [comparables = Jose Bautista, Robinson Chirinos, Ramon Castro, Marco Scutaro]

Harman’s Upside score is higher than I expected it to be. His strong finish to 2007 no doubt boosted his numbers, and his strong 2005 still carries some weight. He also has a relatively low BETA, though there is still some risk there. His first comparable is Jose Bautista, who is turning himself into a somewhat useful player for Pittsburgh, although his bat doesn’t really play up as well at 3B. Interestingly, some of us have been wondering if Harman is going to make the move to 3B as well, maybe as early as this season. Should be an interesting one to watch.

SS

Jason Donald; 51.8 Upside, 0.87 BETA [comparables = Mike Edwards, Tony Manahan, Joe Jester, Adam Piatt]

Donald has the highest upside ranking among all Phillies position player prospects. The odd thing is, scouts don’t seem too enamored with him, pegging him as a utility guy. After a modest 2006 debut, Donald tore up two levels in 2007, which is likely the cause of his Upside rise. His low BETA is also promising, but his comparables list looks pretty damn ugly. Donald is a weird case, because as I mentioned, scouts don’t seem to love him, while PECOTA does, whereas scouts seem to like Cardenas a lot more, yet PECOTA isn’t as high on him. Anyway, 2008 should give us a better indication, as Donald prepares to make the big jump to 2A.

CF

Greg Golson; 9.5 Upside, 1.15 BETA [comparables = Dante Powell, Josh Burrus, Jason Repko, Timmie Morrow]

Not a lot to be optimistic about here, but not surprising. Golson has always been a scouts favorite, and the numbers haven’t bee real pretty. He still doesn’t seem to be able to identify breaking balls, and has only a fastball swing. His comparables list doesn’t do a whole lot to inspire confidence, but his very high BETA score indicates that his prediction is risky, and you always hear the cliche about the “light coming on”….well, if the light does come on, Golson could indeed be a special talent. But if I were the Phillies, I’d be stocking the cabinet with lots of other lamps.

Quintin Berry; 4.7 Upside, 0.94 BETA [comparables = Vincent Blue, Mike Curry, Endy Chavez, Joey Gathright]

Berry’s Upside is lower than Golson’s, but his BETA is much lower and is less risky. Also, the thing that probably jumps out at you the most are the two major leaguers of note in his comparable list. We all know and love Endy Chavez, and fellow speed demon Joey Gathright also appears here. Gathright always struggled getting on base to use his ridiculous speed, but seemed to turn it on a bit last season in Kansas City. Unlike Golson, Berry is already somewhat capable of getting on base regularly, and if that continues as he progresses, he could develop into a nice 4th/5th OF in the Endy/Gathright mold.

RF

Matt Spencer; 10.0 Upside, 0.98 BETA [comparables = Mike Butia, Mark Hamilton, Jason Fransz, Dan Johnson]

Spencer doesn’t get a whole lot of love from PECOTA, but his BETA is right near average in terms of it’s riskiness. Spencer of course only has a half season under his belt, and could see his number rise with a good 2008 campaign. Dan Johnson saw some big league time with Oakland at 1B, and Mark Hamilton is a 1B prospect for the Cardinals, so it might see Spencer as following along that path. I think Spencer is a guy who could outperform the expectations set here.

Jeremy Slayden; 2.9 Upside, 0.95 BETA [comparables = Jason Perry, Jon Hamilton, Ryan Church, Chris Ebright]

Slayden doesn’t fare particularly well here, with a very low upside score. What is interesting, however, is the appearance of Ryan Church on his similar players list. Church was a bit of a late bloomer, not really getting a big league shot until the age of 26. The knock against Slayden has always been his age as he’s climbed the ladder. Church has a defensive edge, as he’s able to play a passable center field, and his arm also profiles better than Slayden’s in RF. Again, not a lot to get excited about here with the low Upside score, but the Church similarity is a glimmer of hope I suppose.

P

Fabio Castro; 33.2 Upside, 1.24 BETA [comparables = Rosario Rodriguez, Onan Masaoka, Arnie Munoz, Felix Heredia]

I’m throwing Fabio on here, he’s not technically a rookie anymore, but after our major leaguers, he scores the highest in the Upside score department. His BETA is very high, which means you need to add an extra grain of salt to this forecast. His comparables list is pretty ugly, though Felix Heredia did manage a 10 year major league career, where he was largely a tick or two below league average. Onan Masaoka is a cool name, no?

Drew Carpenter; 29.3 Upside, 1.47 BETA [comparables = Corey Thurman, John Lackey, Sam Lecure, Brian Sackinsky]

Carpenter is an interesting case. The Upside score isn’t great, but his BETA is very high, and if you look at his comparables, you can probably understand why. Could there be a bigger difference than John Lackey and Brian Sackinsky? Carpenter’s scouting report is basically “modest stuff, good command, battles on the mound”….well, that’s John Lackey, except Lackey’s raw stuff is far from modest. Drew will be in 2A this season, and could be in line for a call up. I guess for now we can dream on him somehow turning into our version of John Lackey….but in the back of our minds knowing he might turn into this guy instead.

Joe Savery; 29.2 Upside, 1.57 BETA [comparables = Corey Lee, Joe Saunders, Michael Pasqualicchio, Wade Leblanc]

Whats with all of our pitching prospects being similar to Angels pitchers? Savery has almost an identical upside to Carpenter, but a higher BETA because of the lack of pro innings. Interestingly, Wade Leblanc is a Padres pitching prospect, and has a very similar arsenal to Savery, with maybe a tick less velocity. Leblanc did well this year in High A and 2A and moved quickly throw the Padres system, so hopefully Savery can follow suit.

JA Happ; 22.3 Upside, 1.24 BETA [comparables = Tim Birtsas, Matt Kinney, Bill Butler, Renie Martin]

Happ, like Carpenter and Savery, has a high BETA factor, which means the system is less sure. His list of comparables is not exactly a “who’s who” of big league all stars. I’m assuming the Bill Butler is this Bill Butler, not Diamondbacks prospect Billy Butler. Happ really had a lost 2007 because of injury and ineffectiveness, but some scouts still remain high on him and think he can make it as a #4 starter. He’ll need to remain healthy and need to sharpen his control and command if he’s going to end up close to that.

Carlos Carrasco; 22.0 Upside, 1.70 BETA [comparables = Rafael Rodriguez, Victor Santos, Calvin Maduro, Tony Armas]

And now the one you were probably scrolling down looking for. PECOTA is not a big fan of Carrasco, and I can guess that is largely due to his poor command and control. His 2006 numbers were impressive, but he still walked his share of batters, and Lakewood’s home park is very pitcher friendly. His 2007 was a mixed bag. After a slow start a Clearwater, he pitched better, but still didn’t ring up the strikeout totals you’d expect from someone with good raw stuff. Of note here is the very high BETA score, the highest of anyone covered so far, so Carrasco could see a big jump, or conversely, could fall off the map in 2008. His comparables list at least includes guys who’ve pitched in the majors. As I’ve said elsewhere, I think the Phillies need to slow down Carrasco and give him time. Scouts still love the stuff (for the most part), and the middle of the rotation potential is there, he just needs to harness his stuff and work on his command.

Antonio Bastardo; 18.8 Upside, 1.50 BETA [comparables = Rafael Quirico, Alberto Bastardo, Jason Dawsey, Cary Ammons]

From complete obscurity to right next to Carlos Carrasco. Bastardo has kind of shot up the boards in Phillies prospectdom, though scouts still see him as a reliever, he does have some upside. His BETA is high, his comparables aren’t impressive, but they do contain another Bastardo. What are the odds? He’ll need to sharpen his secondary stuff as he climbs the ladder, but even if he were able to become a decent middle reliever, that would still be of value to the big club.

Josh Outman; 18.7 Upside, 1.43 BETA [comparables = Josh Kalinowski, Daniel Haigwood, Michael Mimbs, Charlie Manning]

Outman is one of the more interesting guys, not only on this list, but in general. We all know how he greatly altered his mechanics, and how he’s still fairly raw, all things considered. His Upside score isn’t great, his BETA is lower than a bunch of other Phillies guys on this list, but scouts still love the raw velocity and potential. The interesting thing is Dan Haigwood showing up as a similar player. Haigwood was a soft tossing lefty for the most part and lacked Outman’s velocity. His control wasn’t the best though, which is Outman’s biggest fault at this point.

Mike Zagurski; 18.3 Upside, 0.93 BETA [comparables = Neal Cotts, Grant Jackson, Steve Baker, Gerry Arrigo]

Zagurski took the most rapid rise of any Phillies prospect last season, going from Clearwater to the majors in what felt like 2 weeks. When he got to the majors his command deserted him, probably a function of nerves, and he got whacked around a bit. He sustained a hamstring injury which he is still somehow recovering from, but basically is what he is, a lefty reliever who is okay against righties too, thanks to a good changeup. Neal Cotts is a lefthanded reliever for the White Sox, and has similar potential to Zagurski.

Chance Chapman; 11.2 Upside, 1.35 BETA [comparables = Carlos Fisher, Jeff Cosman, Jack Egbert, Jordan Tata]

Chapman had a nice debut at Williamsport last season, and as a two pitch pitcher, could be put on the fast track as a reliever and make it to the majors before many of the guys in his draft class. What’s notable here is that his comparables list contains a similar relief prospect in Carlos Fisher (Reds), and then two starting pitchers in Egbert (White Sox) and Tata (Tigers). Neither Tata nor Egbert really project as more than #4/5 starters, but Tata has already reached the majors, while Egbert saw his prospect status improve after his 2007. If the Phillies move Chapman to the bullpen, he could make it to Philly sometime next season, and he should skip over Lakewood this year before of his age.

Travis Blackley; 10.1 Upside, 1.12 BETA [comparables = Lance Painter, Jorge De Paula, Rigo Beltran, Horacio Estrada]

Blackley, one of our Rule 5 guys who will fight for a spot on the team, doesn’t really have anything of note here to get excited about. Lance Painter had a 10 year big league career with Colorado and St Louis, among others, but wasn’t a very good pitcher. Scouts seem to think some of Blackley’s raw stuff is coming back after labrum surgery, but I’m not overly optimistic, and neither is PECOTA.

Scott Mathieson; 9.8 Upside, 1.18 BETA [comparables = Kyle Wilson, Terric Mcfarlin, Francisco Rosario, Winston Abreu]

PECOTA doesn’t really like Mathieson, but Scott is a weird case, having climbed slowly through the minors, then suddenly adding fastball velocity and improving his K rate, and then jumping to the big leagues, all before having Tommy John surgery. Mathieson’s future role is yet to be determined, though it looks like he might be ticketed as a reliever. Interestingly, Francisco Rosario shows up on his comparables list. I’m not sure if that’s a good thing or not.

Kyle Drabek; 7.9 Upside, 1.51 BETA [comparables = Ricky Stone, Josh Girdley, Steve Karsay, Ryan Tucker]

Drabek’s score is low because he’s struggled so far as a pro, and is coming of Tommy John surgery. The two interesting things here are Steve Karsay and Ryan Tucker showing up in his comparables. Karsay of course had a decent big league career when he wasn’t hurt, but was almost exclusively a reliever after his first few seasons. Tucker is one of the Marlins better prospects, and like Drabek, he throws hard. Tucker lacks a secondary pitch he can rely on, but scouts still love him, much the way they raved about Drabek coming out of high school. If Drabek’s mental approach continues to improve and he comes back healthy, he should steadily move up this list.

And lastly

Joe Bisenius; 7.9 Upside, 1.32 BETA [comparables = Nick Mattioni, Jared Blasdell, Jonah Bayliss, Adam Peterson]

Bisenius has been on the roller coaster of late. He shot through the system in 2006, posting ridiculous strikeout numbers along the way. He hit a road bump in 2007, which was likely caused by overuse the prior year. He scuffled, but if he comes to camp with a fresh arm, he could push his way into the bullpen mix, certainly at some point in 2008 if not out of spring training. His comparables list isn’t pretty, but there’s always hope.

So, let’s summarize, based on the groupings that Silver uses

100+ (Excellent prospect); None
50-100 (Very good prospect) ; Donald
25-49 (Good prospect); Marson, Cardenas, Castro, Carpenter, Savery)
10-25 (Average prospect) ; Harman, Happ, Carrasco, Bastardo, Outman, Zagurski, Chapman, Blackley)
0-10 (Marginal prospect) ; Mathieson, Drabek, Bisenius

All in all, it’s not a pretty picture, based on PECOTA. Scouts like a bunch of our guys a lot more than the system. The one notable omission that surprised me is Dominic Brown’s exclusion. I’m wondering if it was an oversight, and I may try and get ahold of Nate to do a Q/A on the findings, and at the very least ask him about a few guys who didn’t make the cut here. Again, this is just one tool, one more piece of information to add to the memory bank.

I do want to add, PECOTA loves Cole Hamels, giving him an Upside of 250.8, good for 5th best among all pitchers in baseball, and PECOTA also likes Brett Myers, giving him an Upside score of 133.0, good for 29th among all pitchers. These scores will change over time, and a guy who has a moderate score right now could see a big jump up or a big drop down depending on his 2008. Just thought this would be interesting to look at.

23 thoughts on “PECOTA and Phillies prospects

  1. Gotta say I’m not impressed, and prefer the scouting approach. Donald the top position prospect in the system and Castro the best pitcher, with Chapman better than Drabek on upside. Nope.

  2. Awesome! Thank you so much!

    Several things jumped out when reading the BP article, but none more than this:

    “…a typical pitcher can expect to have an ERA about 25% higher if he pitches as a starter instead of out of the bullpen…you’ll find a handful of pitchers rated by PECOTA as among the very best prospects in the game, which wasn’t the case last year.”

    I’m pleased to see these new starter-reliever adjustments. I’ve always felt closers are not as valuable as your top three starting pitchers, but typically closers are valued more than a #3 starter by fans and owners alike.

    A lot of people will clamor for Myers to return to the pen if he isn’t the second coming of Cy Young. If they are using stats as evidence, I doubt they are adjusting numbers correctly or grasping the importance of Innings Pitched.

  3. Gotta say I’m not impressed, and prefer the scouting approach. Donald the top position prospect in the system and Castro the best pitcher, with Chapman better than Drabek on upside. Nope.

    While I think scouting reports are still vital in evaluating prospects, PECOTA is evaluating what a player has done so far, and how that might impact his future. Drabek’s pro numbers haven’t been good, and he just had TJ surgery. The recovery rate is very high, but it still greatly impacts his prospect status.

    I stated a number of times in my intro that PECOTA is not meant as a replacement for the scouting aspect. Nate Silver himself explains that very point. But of course, I still expected the “it’s worthless, I’ll take a scout’s word for it” type comments. Of course, those same scouts still love Greg Golson and think he’s ready to “figure it out” at any moment now. I think these numbers are pretty important, just as scouting reports are pretty important. We tend to fall in love with certain prospects and generally put the blinders on when it comes to non-biased evaluation of those players.

  4. Hanley really is a freak of nature. And just a couple of seasons ago, people were wondering if he was ever going to become an above average regular, let alone one of the best players in baseball.

  5. Interesting stuff… good work, phuturephillies.

    We’ve talked about how the Phillies’ system has been devoid of high level talent (and by that I mean AA and AAA) pretty much since Hamels graduated to the majors. But with Outman, Carrasco, Carpenter, Donald and Harman all making the move to Reading this year, we also said the system could look a lot better in just six months if all or most of those guys steps up. And I think that would be reflected in next year’s PECOTA, especially with someone like Carrasco.

    Good call on Dominic Brown, because I’d be interested to hear what Silver has to say on him. In that vein, any word on Drew Naylor? I thought maybe it might be because he’s only pitched a season and a half over here, but that didn’t stop them from including Bastardo.

  6. Here’s the deal with this. Chapman turns in good, not awe inspiring numbers in short season ball at age 23. He makes the list of plus guys. A guy like Garcia on rehab put up better numbers on the same team at age 20, but misses the list. Naylors got a higher, but generally better peripherals as age 21. Also on the same team, German is a year younger than Chapman and has absolutely crazy stats and kept them up at Lakewood. Even as a 23-year old in short season ball, Chapman doesn’t have the Ks.

  7. The best thing I learned is that one of the guys most like Bastardo, is . . well . . . Bastardo. Just a couple of Bastardos, I guess.

  8. ouch. Without knowing how PECOTA treats other teams’ prospects, that looks beyond uninspiring.

    I will say that I didn’t hate the Chapman pick and think that though fair to say his numbers were only very good against younger competition at the Port, his numbers were off the charts at a very good college program and most scouting reports say he has a Major League slider. I want to see him spend the year between Clearwater and Reading and figure him out quick.

    I mean, if he’s contributing to our bullpen in any meaningful way by 09, that pick may not be popular with prospect mavens, but it would be an astute investment.

  9. I like Chapman, and while the home/away split that Rickey Branch mentions is a concern, I think the biggest numbers to keep an eye on are his inning-by-inning splits:

    Innings 1-3: 37.1 IPs — 6.0 H/9 — 2.2 BB/9 — 9.4 K/9
    Innings 4-7: 32.3 IPs — 10.6 H/9 — 2.2 BB/9 — 6.1 K/9

    He’s clearly earmarked to be a reliever, and it sounds like he’s got the raw stuff to do it (including a 1.85 GO/AO last year). Personally, I have high hopes for Chapman to climb the ladder quickly this year.

    Oh and phuturephillies, not meaning to repeat myself, but does PECOTA not have a projection for Drew Naylor?

  10. PECOTA makes the Phillies’ prospects look pretty dismal,
    which is not entirely surprising in view of other, more
    traditional evaluations. I look forward to the day when
    this site will be able to tout some real prospects rather
    than the mediocrities we now are dealing with.

  11. I agree with several above, this is going to be a real big year for the farm system. So many guys are moving up to AA and the guys up there really need to deliver to cement their status. The usage of the six picks will also tell a lot. The farm system could make a big turnaround by this time next year. Or it could get worse. Who knows.

  12. Thanks for the explanation of PECOTA. Seems like a quantitative method would have some value as a countercheck to scouting reports. I wonder if some of the seeming anomalies pointed out are due to not evaluating all players in the system. Who gets evaluated? Also, I wonder how much raw physical traits and power pitches are weighted versus performance factors. Again, thanks for the intro. Would like to learn more about the overall approach in profiling a player, what gets weighted how much, etc.

  13. Excellent work. I think more than anything this demonstrates that different systems sometimes project different things. No system is fullproof. Someone is very wrong about Drabek. Is it the scouts? Is it Pecota? Someone is also very wrong about Donald? It’s sorta like God. Unless you’re an atheist you believe in some higher being. Who’s right? The atheists or the believers? When you’re dead you’ll know the definitive answer. And 5 years from now, when these prospects either blossom or implode will we know this baseball answer for certain as well.

    What I’d like to see is a comparison of what happened to sure things ( prospects over 100 or given the highest ratings by scouts) and sure no things ( less than ten or given the lowest rating by scouts ) in the years 1997-2002 and see who in retrospect made the fewest mistakes on sure things and underestimated the surprise players the most.

  14. I wish I still had the 2007 PECOTA weighted means. I might have deleted it. Anyway, Nate Silver did a whole series, breaking it down position by position, and he’s doing the same thing this year, I do believe. The first article in the series is linked above, not sure if it’s “premium content”, so you might be able to read them, you might not. But he goes position by position, and you can find all of the articles linked at the bottom of the original article, which I guess I’ll just post again here.

    http://www.baseballprospectus.com/article.php?articleid=5836

    Here were the prospects he had ranked at 100+ or higher last year, by position

    C: Chris Iannetta, Jarrod Saltalamacchia

    Both were considered consensus guys by scouts. Ianetta really struggled, Salty held his own and is now considered the better prospect. Ruiz, coincidentally, was ranked #4 behind Miguel Montero.

    1B: Joey Votto

    Votto is now one of the top prospects in baseball. James Loney scored 81.8, and obviously turned out well, while Daric Barton scored 73.7 and looks like Oakland’s future 1B/DH.

    2B: Dustin Pedroia, Eric Patterson, Brooks Conrad

    Pedroia, well that story has been told. Patterson and Conrad appear to have taken steps back, but Silver kind of warned that could happen based on the system.

    3B: Alex Gordon, Evan Longoria, Kevin Kouzmanoff, Andy LaRoche, Billy Rowell

    Gordon had a good 2nd half after a slow start, Longoria is either #1A or #1B in terms of overall prospects in the minors. Kouz started slow and finished strong, LaRoche is a Top 20 prospect, and Rowell is still tough to figure out, as he played the entire year in Low A as an 18 year old and held his own, which is kind of a rarity, after destroying the short season leagues as a 17 year old.

    SS: Alexi Casilla, Brent Lillibridge, Sean Rodriguez, Brandon Wood, Reid Brignac, Elvis Andrus

    The one interesting one here is Brignac, who was ranked above all of the guys with higher upside scores, except maybe Brandon Wood, among scouts, but he suffered a bit of a down year.

    CF: Chris Young, Felix Pie, Fernando Martinez, Cameron Maybin, Adam Jones, Cedric Hunter

    Young was a big part of Arizona’s offense, almost going 30-30 as a rookie, Jones and Maybin were part of blockbusters and are considered elite talents. Pie is likely to be the Cubs starting CF, Martinez is the Mets best prospect, and Hunter struggled quite a bit in 2007

    LF/RF: Delmon Young, Billy Butler, Jay Bruce

    Kind of a weird split here. Bruce is now the much more valuable commodity, while Delmon’s stock dipped a bit. Butler really isn’t a corner OF anymore, he’s a DH, but he had a nice debut last year.

    LHP: Clayton Kershaw, Brent Fisher, Kei Igawa

    Kershaw is the best LHP prospect in the minors, Fisher got hurt, and Igawa was a disaster. Silver said that he didn’t find Igawa an interesting prospect, but PECOTA viewed him as an already established commodity because of his age and experience in Japan.

    RHP: Tim Lincecum, Phil Hughes, Yovani Gallardo, Kevin Slowey

    The only split from the scouts here is Slowey, who always had impeccable control in the minors but didn’t have great raw stuff. He got knocked around during his first callup, but then pitched pretty well his 2nd time up. The other 3 guys remain elite young pitchers.

    So really, the Upside guys tend to dovetail nicely with the guys scouts are big on, with just a few exceptions. Again, that’s only for 1 season, just a quick snapshot.

  15. Isn’t it ironic that Kyle Kendrick was the only pitcher to get votes( a second and 3 third place votes) in the 07 NL Rookie of the Year balloting. Wonder where he ranked?

Comments are closed.