What are some good ways to get rare materials

There's no good substitute for just playing the game, a lot.

Time is what you need to invest in.

Specifically, here's what I do in order go get the upgrade materials:

• Spinmetal: Patrol on earth, go to mothyards and run circles in the zone, kill all enemies, pick up spinmetal out in the open and visit every cave and spawn area to look for chests. Chests usually contain 1-2 of the appropriate upgrade material for the area.
• Relic Iron: Patrol on mars, go down to the left through the tunnels to the dome building beyond and start a loop there:
  • Enter the dome, kill everything inside (sometimes a yellow colossus or a couple of yellow psions so some money as well), then visit the following chest areas:
    • Inside spawn area back right
    • Out of the spawn area back right and hold right until you're back inside another spawn area just next to it
    • Just outside that spawn area, against the separating wall just outside, to the right, there can be a chest
    • Exit the room with the separating wall and go immediately right, behind a low wall there can be a chest and in the corner there can spawn a relic iron node
    • Out on the half-circular walkway, to the right when you're looking out of the building, against the wall behind some large mechanical equipment there can spawn a chest
    • Below the half-circular walkway, to the left when you're looking out of the building, on the sand dunes there can spawn both relic irons and chests in various positions
  • Go across to building five, out of the dome building and 90 degress to the left, run straight forward and there is a spawn area in the bottom of the building
  • Go out of that spawn area and run across to the other entrance to the dome, can be a relic iron outside to the right of the doorway, enter inside and kill the two enemies and check the spawn area behind them
  • Go out of the dome area and turn slightly left, run across to the next building to the left of the silos and enter the spawn area there, can be a yellow enemy or two outside as well
  • Exit the spawn area and turn 90 degrees left and go into building five behind the silos and kill everything in your path, straight ahead there is a spawn area
  • Up top in building five there is a spawn area, behind the yellow colossus
  • Exit building five topside through the broken wall and head back into the dome to start over
• Spirit bloom: Patrol on venus and take the path to the right. Stop at the building and run a loop checking the following areas:
  • Spawn area in the first buildings on the right
  • Run a circle around the very first building on the right, along the broken tiled ground and check for a couple of chests that can be located either on it, against the wall, or just below it, typically on the very outskirts of the map. There's also a few spirit blooms that can spawn in some of the vegetation here.
  • Check the corners of the first area, there can be spirit blooms here
  • In the first area, when you start running towards the next area, there is a stairway with a low wall on the left, there can be a chest behind this wall.
  • Below the stairway there is a spawn area on the left.
  • Out among the cars in the battlefield there can spawn a few spirit blooms, typically next to vegetation
  • Run to the next area, the area with the billboards, a few cars, and the double stairway up to the entrance to the path to the academy. There can be spirit blooms in the corners here.
  • Also next to this area there is a spawn area that can contain a chest
  • Run to the next building on the far side, the one where the servitor and a few fallen spawns. Check the spawn area and behind all the pillars in the room, and also the room on the top of the stairs here, chests can spawn a lot of places here.
  • Run back and start again, everything should have spawned by now.
• Helium filaments: Patrol the moon and go to the mushroom-like building (sorry, I forgot what its called). Start a loop going from this around the mountain to the refinery-like building and back, killing everything in your path and checking every corner and spawn area for nodes. Apologize for not having a clearer list of spawn areas here.

That should take care of the basic grind.

There's also a couple of other ways to get the basic upgrade materials:

• You can get them when turning in bounties, so do your bounties every day if you can
• You can sometimes get them as an extra reward when completing the daily heroic mission or the weekly heroic strike
• You can buy them from either the crucible quartermaster or the vanguard quartermaster for 10 marks of the respective type. You get 20 units of the upgrade material of your choice.

When it comes to the more hard to get upgrade materials, ascendant energy and ascendant shard, you need to:

• Do at least one public event every day, the first one will often give you 1-2 of these items
• Decrypting blue and legendary engrams with the cryptarch will sometimes decrypt into one of the ascendant items instead of a weapon or armor. You can also get strange coins or motes of light.
• The odd chest will give you this, but this is rare

The final material, exotic shards, can be obtained the following ways:

• Dismantle exotic gear
• Buy one from Xûr for 7 strange coins