My kids both won goldfish in a cup from school when they were in elementary school. I bought a glass fishbowl (less than $10, not a "tank" with filter, etc). One died within a few days. One lasted several months. But goldfish are not known to be very hardy. LOL
Put the fish bowl away in the attic. Then, at age 11, daughter visited a friend at her house and her friend had a beta fish. Daughter fell in love and wanted one. I did a lot of reading, and found that they are pretty hardy fish if you keep the tank clean. Various websites give differing information, but I have found that once a week total bowl changes work fine. The fish is a year and a half old now. Still looks beautiful. Just bought a moss ball to add the bowl. :)
The males are the ones with the flowing fins.. the females are a bit plainer. Do not get one of those small plastic "beta tanks" that they sell. They are often smaller than a gallon and really are not suited to the fish. They need a minimum of 1 gallon. Which is approx what our bowl is... it might be slightly larger. They don't even need gravel. Though we put a small amount of natural looking rocks/gravel in the bottom, to secure a live plant in.
Fish food is minimal cost. You simply buy the little bottles of chlorine treatment to make the water habitable for them and change the water once a week. That's about it. No big deal. The fish cost about $7 at a pet store (not Walmart). The only issue we've encountered is that the bowl is too small to put a heater in, (it would overheat the water due to the size) so in winter we have to be careful to keep it in a warm room. They don't like it or do well when the water temp drops below around 75 degrees. And our house stays around 68 or 70 in winter unless it is a room with windows and sun coming in, or the kitchen where the tea kettle and stove/oven keep it warmer than other spaces.
---
oh, and the water changes aren't to keep algae from growing as much as to keep the ammonia at a level the fish can tolerate. Without a filter, the ammonia levels build up quickly in the water.