Widgets - how do they work?

If you have a widget running on one of the home screens, does that mean that the app is actually running in the background? Does this also mean that the more widgets you have the more likely your device is to lag? If the app is not running in the background, where is the content downloaded from?

Can someone explain to me how widgets work?