Instructions
Consider the thickness of the legs surrounding the joints. Certain spiders have proportionately robust limbs. Tarantulas, many of which are predominantly black with a huge range of colorful patterns, have thick, rubbery-looking legs, for example. A black widow's, in comparison, appear thread-thin.
Look at the length of the legs. Jumping spiders often have black joints, but their legs, unlike those of many spiders, are usually held close to the body and are relatively short. Indeed, many roughly resemble a hermit crab in structure. A garden spider will have much longer limbs in proportion to its body, splayed out as it waits in ambush on the strands of its web (if it is a female, which are more conspicuous and more commonly seen).
Study the shape of the spider. Trapdoor spiders, found across much of North America and related to tarantulas, have formidably large jaws (in addition to thick legs). A shamrock orbweaver, which has black banding on its legs, has a massive abdomen in proportion to the rest of its body.
Consider the spider's behavior and general habitat. A female black widow will usually be seen ensconced in a web in some dark, out-of-the-way place such as a cellar corner or a wood-pile. A jumping spider, which is not a nest-builder, will be actively roaming in search of prey.
Use a magnifying glass to discern other physical features that will help you at least identify a spider to a family. For example, the arrangement of a spider's eyes can often get you this far. You might also look at coloration patterns beyond the black knobs of the legs, as well as relative proportions of the body segments.