pdowd, you should listen to more people than just Larry in this thread. These are cities, with bad areas and good areas, like any other city. (And Larry, Buffalo has bad parts too, so I think he's probably familiar with this idea)
One thing that's struck me about all California bad neighborhoods is that it's often block-by-block. These blocks are fine but literally 50 yards away is urban hell. It was a lot easier in Philly- the bad neighborhoods are much more clearly defined and larger.
Also, to be super-clear- the Iron Triangle is maybe the most fucked part of the East Bay. Maybe Edes off of 98th Ave in East Oakland is worse. Maybe.
But there's so much more of the Bay Area: Oakland, Emeryville, Berkeley, Albany, El Cerrito, Richmond, Hayward, & San Leandro included. All of these are bikable, on BART (local subway system), and on AC Transit (local bus system).
As the only elected member of the Berkeley Rent Board on this message board, I can confirm that yes, rents are still increasing. $1000 is the average for a studio in town. It was actually close to the average 10 years ago, but after it went up further in the 2000s, it dropped slightly- very slightly- and is hovering around $1K. A law called Costa-Hawkins was passed in 1998 and gave landlords the right to rent at market rate whenever they have a new vacancy (it's also called "vacancy decontrol"). Previously, the new rent would've been much closer to the controlled rent. This meant that rents jumped from something like $500/month to $900/month for a studio. Anyway, roommates are the way you're gonna have to go.
Come on out, meet people, and see what you can find! Keep your city-kid sense and good luck!
P.S.- Please understand that Larry takes any opportunity to bash this area for his own reasons (personal history, political differences with the locals, where he's at with what he's comfortable with/worried about) and evaluate his comments through this filter. If you read any thread where S.F., Oakland, or Berkeley are mentioned, you'll see what I mean- it's almost all negative and almost never positive. To be clear, I am not saying that he's untruthful. I'm saying that he's emphasizing the negative to a point that is weird to other transplants like me who also chose to live in this area for a couple of decades.