What are the data mining platform does Space agencies such as Nasa or SpaceX use? Just a few would be helpful. This is for data mining and data analysis purpose.
In general, i was looking something like R, Python or SQL.
11
-
$\begingroup$ Possibly worth clarifying, are you interested in engineering work or science? SpaceX, Boeing and NASA do engineering work that would involve data analysis about launch systems and hardware, but from the phrasing of your question are you more interested in the analysis of space probe results? In which case that is often done by the organizations outside NASA that provided individual instruments. There is probably no single answer to this question. $\endgroup$– GremlinWrangerCommented Feb 15, 2020 at 1:03
-
$\begingroup$ @GremlinWranger - Thanks for the notes.. ; I come from programming background and i am interested in the engineering work. My interest are towards the data. Source of data, mode of transfer, data storage and finally how to analyze the data from which we received. Space agencies are following this process. I am in a very early stage on collecting these details $\endgroup$– goofyuiCommented Feb 15, 2020 at 1:16
-
$\begingroup$ @GremlinWranger - If you have some suggestions about the companies or instruments handling the space probe results will be helpful for me to study them. $\endgroup$– goofyuiCommented Feb 15, 2020 at 1:22
-
$\begingroup$ Boring way to answer your question is via Wikipedia, look at recent probes and find which organisation built it. Then search for papers using data from that instrument and check what process was used. A useful term is 'Principal investigator', who normally is the person who came up with the instrument, and is responsible for it's mission. Research using the data will probably feature their name. $\endgroup$– GremlinWrangerCommented Feb 15, 2020 at 1:28
-
2$\begingroup$ NASA directly employs almost 20000 people and employs another 60000 through its contractors. If only 0.1% of those employees use / develop data mining techniques, that makes for 800 data miners at NASA. And that is a ridiculously low estimate. Data mining is used at NASA to help solve a very wide variety of problems. The large number of data miners and the large number of problem domains is what makes this problem overly broad. $\endgroup$– David HammenCommented Feb 15, 2020 at 21:20
|
Show 6 more comments
1 Answer
$\begingroup$
$\endgroup$
3
NASA manages several repositories of data, one of interest is software which includes things like code for image processing working with google earth, A c++ 'mass atrocity predictor' or kernal for code verification. In terms of technology used I'd assume space agencies will use pretty much anything (lots of Fortran code there) that has ever existed, and some of their own devising because of the various unique needs.
answered Feb 15, 2020 at 1:23
-
$\begingroup$ Thank you, You mentioned about Image based data - Which is processed through C++ or could be Python to an extent. Second data could be - Signals what are send from Sat's , space vehicles - How this data is analyzed ? Do they have any data mining environment to handle ? And also, I am surprised to hear about Fortran. I never thought they will have fortran in today's date. $\endgroup$– goofyuiCommented Feb 15, 2020 at 1:26
-
$\begingroup$ Suspect Fortran is not used in the analysis any more, but is most likely still in the raw data path to the repository, because these missions fly for decades and you don't break things that work. Possibly worth holding off accepting the answer for at least 24 hours to see if anybody actually working the field posts something authoritve $\endgroup$ Commented Feb 15, 2020 at 1:32
-
$\begingroup$ I take back. Fortran is still in use. ( nas.nasa.gov/publications/ams/2015/04-28-15.html ) $\endgroup$– goofyuiCommented Feb 15, 2020 at 1:50