-
Notifications
You must be signed in to change notification settings - Fork 705
Upgrading to 0.9.0
daisyzhou edited this page May 2, 2014
·
3 revisions
-
def config
in Job does not accept a mode. Job hasJob.mode
use that if you need it.def listeners
in Job no longer accepts a mode either. -
sum
takes a type parameter in the fields API.sum[Double]
is equivalent to the old behavior, but you might wantsum[Long]
or any otherT
that has analgebird.Semigroup[T]
. Without the type parameter you get:diverging implicit expansion for type com.twitter.algebird.Semigroup[T]
- TypedSink and Mappable need setter and converter defined. Using TupleSetter.asSubSetter, or TupleConverter.asSuperConverter can help here. (add better docs, please if you get confused).
- RichDate parsing needs an implicit scalding.DateParser. Job has one in scope that follows the old rules (minus natty), but you may need to set an implicit DateParser outside of a Job. (See DateParser.default).
-
JsonLine
has been extracted intoscalding-json
module.
These sed rules may help.
- Scaladocs
- Getting Started
- Type-safe API Reference
- SQL to Scalding
- Building Bigger Platforms With Scalding
- Scalding Sources
- Scalding-Commons
- Rosetta Code
- Fields-based API Reference (deprecated)
- Scalding: Powerful & Concise MapReduce Programming
- Scalding lecture for UC Berkeley's Analyzing Big Data with Twitter class
- Scalding REPL with Eclipse Scala Worksheets
- Scalding with CDH3U2 in a Maven project
- Running your Scalding jobs in Eclipse
- Running your Scalding jobs in IDEA intellij
- Running Scalding jobs on EMR
- Running Scalding with HBase support: Scalding HBase wiki
- Using the distributed cache
- Unit Testing Scalding Jobs
- TDD for Scalding
- Using counters
- Scalding for the impatient
- Movie Recommendations and more in MapReduce and Scalding
- Generating Recommendations with MapReduce and Scalding
- Poker collusion detection with Mahout and Scalding
- Portfolio Management in Scalding
- Find the Fastest Growing County in US, 1969-2011, using Scalding
- Mod-4 matrix arithmetic with Scalding and Algebird
- Dean Wampler's Scalding Workshop
- Typesafe's Activator for Scalding