Issues in data management in observing systems and lessons learned