There's actually an algorithm designed exactly for this purpose: generating a sequence of keys from one master key. It's called HKDF (HMAC-based Key Derivation Function, paper here).
The algorithm essentially boils down to two steps: Extract and Expand. The Extract step accepts any type of "key material" as input, and outputs a pseudorandom key that will be used in the next step. The purpose of this step is to eliminate any patterns, structure, or bias in the input key, and produce a uniformly pseudorandom output.
If the master key is already a string of uniformly pseudorandom bytes (i.e. it was generated using a crypto-secure RNG), it's safe to skip the Extract step (but be sure to read the notes in the RFC).
The second step, Expand, uses the pseudorandom key from the first step to produce an arbitrary length output. Typically, Expand is used to produce a long output, and that output is divided up into smaller keys (e.g. 1024 bits divided into four 256-bit keys). However, it is also possible to use Expand once for each key, while providing a different value each time for the "info" parameter. This is likely slower, but may be more elegant from an engineering perspective.
HKDF is carefully designed to avoid the problem you identified. If any of the output keys are ever revealed to an attacker, the remaining keys are still safe. Of course, if the master key is discovered, game over.
I suggest reviewing the RFC: it's reasonably straightforward, and includes many helpful suggestions on usage. Section 2 has a precise description of the algorithm.
With regard to performance, let's assume you skip the Extract step and use HKDF with a hash function whose output size matches the desired key size. The algorithm can now be simplified to $\operatorname{HMAC}(\mathit{key}, \mathit{info} \| 1)$ (where $1$ is the single byte 0x01). If performance is important, it's possible to precompute parts of the HMAC calculation given the master key. Assuming a short "info" parameter, only two invocations of the underlying compression function are needed per key (assuming the use of a Merkle-Damgard hash function like SHA-2, SHA-1, or MD5).
Contrast this with a scheme such as $h(\mathit{key}, \mathit{info})$ (a keyed hash function). With optimizations, only one invocation of the compression function is needed per key. However, this gives up (1) the security analysis and arguments provided by HKDF, (2) HMAC's additional security against breaks in the hash function, and (3) forces you to consider length extension attacks, among other things.