Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Big Data and Causality

Big Data and Causality Causality analysis continues to remain one of the fundamental research questions and the ultimate objective for a tremendous amount of scientific studies. In line with the rapid progress of science and technology, the age of big data has significantly influenced the causality analysis on various disciplines especially for the last decade due to the fact that the complexity and difficulty on identifying causality among big data has dramatically increased. Data mining, the process of uncovering hidden information from big data is now an important tool for causality analysis, and has been extensively exploited by scholars around the world. The primary aim of this paper is to provide a concise review of the causality analysis in big data. To this end the paper reviews recent significant applications of data mining techniques in causality analysis covering a substantial quantity of research to date, presented in chronological order with an overview table of data mining applications in causality analysis domain as a reference directory. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Annals of Data Science Springer Journals

Big Data and Causality

Download PDF
24 pages

Loading next page...
 
/lp/springer-journals/big-data-and-causality-hme0a9rw5Q
Publisher
Springer Journals
Copyright
Copyright © 2017 by Springer-Verlag GmbH Germany
Subject
Business and Management; Business and Management, general; Statistics for Business/Economics/Mathematical Finance/Insurance; Computing Methodologies
ISSN
2198-5804
eISSN
2198-5812
DOI
10.1007/s40745-017-0122-3
Publisher site
See Article on Publisher Site

Abstract

Causality analysis continues to remain one of the fundamental research questions and the ultimate objective for a tremendous amount of scientific studies. In line with the rapid progress of science and technology, the age of big data has significantly influenced the causality analysis on various disciplines especially for the last decade due to the fact that the complexity and difficulty on identifying causality among big data has dramatically increased. Data mining, the process of uncovering hidden information from big data is now an important tool for causality analysis, and has been extensively exploited by scholars around the world. The primary aim of this paper is to provide a concise review of the causality analysis in big data. To this end the paper reviews recent significant applications of data mining techniques in causality analysis covering a substantial quantity of research to date, presented in chronological order with an overview table of data mining applications in causality analysis domain as a reference directory.

Journal

Annals of Data Science – Springer Journals

Published: Aug 1, 2017

References

  • Big data: a revolution that will transform how we live, work, and think
    Mayer-Schonberger, V; Cukier, K
  • Business intelligence and analytics: from big data to big impact
    Chen, H; Chiang, RH; Storey, VC
  • Crime data mining: a general framework and some examples
    Chen, H; Chung, W; Xu, JJ; Wang, G; Qin, Y; Chau, M
  • Introduction to data mining with case studies
    Gupta, GK
  • Data mining and official statistics: the past, the present and the future
    Hassani, H; Saporta, G; Silva, ES
  • Evolving data into mining solutions for insights
    Fayyad, U; Uthurusamy, R
  • Some recent development in a concept of causality
    Granger, CW
  • Energy consumption and GDP: causality relationship in G-7 countries and emerging markets
    Soytas, U; Sari, R
  • Detecting causality in complex ecosystems
    Sugihara, G; May, R; Ye, H; Hsieh, CH; Deyle, E; Fogarty, M; Munch, S
  • Does sunspot numbers cause global temperatures? A reconsideration using non-parametric causality tests
    Hassani, H; Huang, X; Gupta, R; Ghodsi, M
  • Causality analysis detects the regulatory role of maternal effect genes in the early Drosophila embryo
    Ghodsi, Z; Huang, X; Hassani, H
  • A review of data mining applications in crime
    Hassani, H; Huang, X; Silva, ES; Ghodsi, M
  • A review on time series data mining
    Fu, TC
  • Mining the pharmacogenomics literaturea survey of the state of the art
    Hahn, U; Cohen, KB; Garten, Y; Shah, NH
  • A review of data mining using big data in health informatics
    Herland, M; Khoshgoftaar, TM; Wald, R
  • A review of causal inference for biomedical informatics
    Kleinberg, S; Hripcsak, G
  • A review of financial accounting fraud detection based on data mining techniques
    Sharma, A; Panigrahi, PK
  • Information extraction
    Cowie, J; Lehnert, W
  • Linked data-the story so far
    Bizer, C; Heath, T; Berners-Lee, T
  • Force dynamics in language and cognition
    Talmy, L
  • Toward future scenario generation: extracting event causality exploiting semantic relation, context, and association features
    Hashimoto, C; Torisawa, K; Kloetzer, J; Sano, M; Varga, I; Oh, JH; Kidawara, Y
  • Extracting arabic causal relations using linguistic patterns
    Sadek, J; Meziane, F
  • Comparative experiments on learning information extractors for proteins and their interactions
    Bunescu, R; Ge, R; Kate, RJ; Marcotte, EM; Mooney, RJ; Ramani, AK; Wong, YW
  • BioInfer: a corpus for information extraction in the biomedical domain
    Pyysalo, S; Ginter, F; Heimonen, J; Bjrne, J; Boberg, J; Jarvinen, J; Salakoski, T
  • RelExRelation extraction using dependency parse trees
    Fundel, K; Kffner, R; Zimmer, R
  • BioCause: annotating and analysing causality in the biomedical domain
    Mihăilă, C; Ohta, T; Pyysalo, S; Ananiadou, S
  • Semi-supervised learning of causal relations in biomedical scientific discourse
    Mihăilă, C; Ananiadou, S
  • Learning to extract adverse drug reaction events from electronic health records in Spanish
    Casillas, A; Pérez, A; Oronoz, M; Gojenola, K; Santiso, S
  • ISO-TimeML: an international standard for semantic annotation
    Pustejovsky, J; Lee, K; Bunt, H; Romary, L
  • A PDTB-styled end-to-end discourse parser
    Lin, Z; Ng, HT; Kan, MY
  • Corpus annotation for mining biomedical events from literature
    Kim, JD; Ohta, T; Tsujii, JI
  • Learning based Java for rapid development of NLP systems
    Rizzolo, N; Roth, D
  • A comprehensive survey of clustering algorithms
    Xu, D; Tian, Y
  • Clustering of cases of insulin dependent diabetes (IDDM) occurring three years after hemophilus influenza B (HiB) immunization support causal relationship between immunization and IDDM
    Classen, JB; Classen, DC
  • Functional clustering of time series gene expression data by Granger causality
    Fujita, A; Severino, P; Kojima, K; Sato, JR; Patriota, AG; Miyano, S
  • Recovering directed networks in neuroimaging datasets using partially conditioned Granger causality
    Wu, G; Liao, W; Stramaglia, S; Chen, H; Marinazzo, D
  • Analyzing the connectivity between regions of interest: an approach based on cluster Granger causality for fMRI data analysis
    Sato, JR; Fujita, A; Cardoso, EF; Thomaz, CE; Brammer, MJ; Amaro, E
  • An intelligent decision-support model using FSOM and rule extraction for crime prevention
    Li, ST; Kuo, SC; Tsai, FC
  • Financial development and growth: a clustering and causality analysis
    Chow, WW; Fung, MK
  • ST-DBSCAN: an algorithm for clustering spatialtemporal data
    Birant, D; Kut, A
  • Identification of causal factors for the Majiagou landslide using modern data mining methods
    Ma, J; Tang, H; Hu, X; Bobet, A; Zhang, M; Zhu, T; Song, Y; Eldin, MAE
  • Data-driven discovery of quantitative rules in relational databases
    Han, J; Cai, Y; Cercone, N
  • The mahalanobis distance
    Maesschalck, R; Jouan-Rimbaud, D; Massart, DL
  • GTM: the generative topographic mapping
    Bishop, CM; Svensen, M; Williams, CK
  • Mining association rules on significant rare data using relative support
    Yun, H; Ha, D; Hwang, B; Ryu, KH
  • Mining association rules between sets of items in large databases
    Agrawal, R; Imieliński, T; Swami, A
  • A simple constraint-based algorithm for efficiently mining observational databases for causal relationships
    Cooper, GF
  • Scalable techniques for mining causal structures
    Silverstein, C; Brin, S; Motwani, R; Ullman, J
  • Discovering causality in large databases
    Zhang, S; Zhang, C
  • Using data mining to study upstream and downstream causal relationship in stock market
    Hsieh, YL; Yang, DL; Wu, J
  • Efficient mining of profit rules from closed inter-transaction itemsets
    Hsieh, YL; Yang, DL; Wu, J; Chen, YC
  • Practical approaches to causal relationship exploration
    Li, J; Liu, L; Le, T
  • From observational studies to causal rule mining
    Li, J; Le, TD; Liu, L; Liu, J; Jin, Z; Sun, B; Ma, S
  • A potential causal association mining algorithm for screening adverse drug reactions in postmarketing surveillance
    Ji, Y; Ying, H; Dews, P; Mansour, A; Tran, J; Miller, RE; Massanari, RM
  • A method for mining infrequent causal associations and its application in finding adverse drug reaction signal pairs
    Ji, Y; Ying, H; Tran, J; Dews, P; Mansour, A; Massanari, RM
  • Postmarketing drug safety surveillance using publicly available health-consumer-contributed content in social media
    Yang, CC; Yang, H; Jiang, L
  • Using health-consumer-contributed data to detect adverse drug reactions by association mining with temporal analysis
    Yang, H; Yang, CC
  • Text and data mining techniques in adverse drug reaction detection
    Karimi, S; Wang, C; Metke-Jimenez, A; Gaire, R; Paris, C
  • Mining association patterns of drug-interactions using post marketing FDAs spontaneous reporting data
    Ibrahim, H; Saad, A; Abdo, A; Eldin, AS
  • A functional temporal association mining approach for screening potential drugdrug interactions from electronic patient databases
    Ji, Y; Ying, H; Tran, J; Dews, P; Lau, SY; Massanari, RM
  • Dynamic association rules for gene expression data analysis
    Chen, SC; Tsai, TH; Chung, CH; Li, WH
  • DBMiner: a system for mining knowledge in large relational databases
    Han, J; Fu, Y; Wang, W; Chiang, J; Gong, W; Koperski, K; Xia, B
  • Efficient mining of intertransaction association rules
    Tung, AKH; Lu, H; Han, J; Feng, L
  • Classification and regression trees
    Breiman, L; Friedman, J; Olshen, R; Stone, C
  • C4.5: program for machine learning
    Quinlan, JR
  • Induction of decision trees
    Quinlan, JR
  • A fast algorithm for computing longest common subsequences
    Hunt, JW; Szymanski, TG
  • MobiMine: monitoring the stock market from a PDA
    Kargupta, H; Park, BH; Pittie, S; Liu, L; Kushraj, D; Sarkar, K
  • A causal feature selection algorithm for stock prediction modeling
    Zhang, X; Hu, Y; Xie, K; Wang, S; Ngai, EWT; Liu, M
  • Discovering golden nuggets: data mining in financial application
    Zhang, D; Zhou, L
  • Towards a causal model for air transport safetyan ongoing research project
    Ale, BJM; Bellamy, LJ; Cooke, RM; Goossens, LHJ; Hale, AR; Roelen, ALC; Smith, E
  • Further development of a causal model for air transport safety (CATS): building the mathematical heart
    Ale, BJ; Bellamy, LJ; Boom, R; Cooper, J; Cooke, RM; Goossens, LH; Spouge, J
  • Study of Spanish mining accidents using data mining techniques
    Sanmiquel, L; Rossell, JM; Vintro, C
  • Causal decision trees
    Li, J; Ma, S; Le, T; Liu, L; Liu, J
  • Neural network classifiers estimate Bayesian a posteriori probabilities
    Richard, MD; Lippmann, RP
  • Neural networks for classification: a survey
    Zhang, GP
  • A note on least-squares learning procedures and classification by neural network models
    Shoemaker, PA
  • Neural network classification: a Bayesian interpretation
    Wan, EA
  • Neural networks: applications in industry, business and science
    Widrow, B; Rumelhart, DE; Lehr, MA
  • Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes
    Tu, JV
  • A Bayesian neural network method for adverse drug reaction signal generation
    Bate, A; Lindquist, M; Edwards, IR; Olsson, S; Orre, R; Lansner, A; Freitas, RM
  • Coarse-grained reverse engineering of genetic regulatory networks
    Wahde, M; Hertz, J
  • Neural network model of gene expression
    Vohradský, J
  • Modeling of gene regulatory networks with hybrid differential evolution and particle swarm optimization
    Xu, R; Venayagamoorthy, GK; Wunsch, DC
  • A neural network analysis of militarized disputes, 1885–1992: temporal stability and causal complexity
    Lagazio, M; Russett, B
  • Neural networks with non-uniform embedding and explicit validation phase to assess Granger causality
    Montalto, A; Stramaglia, S; Faes, L; Tessitore, G; Prevete, R; Marinazzo, D
  • Least squares support vector machine classifiers
    Suykens, JA; Vandewalle, J
  • A support vector machine approach for detecting genegene interaction
    Chen, SH; Sun, J; Dimitrov, L; Turner, AR; Adams, TS; Meyers, DA; Hsu, FC
  • Ranking causal variants and associated regions in genome-wide association studies by the support vector machine and random forest
    Roshan, U; Chikkagoudar, S; Wei, Z; Wang, K; Hakonarson, H
  • Detection of cerebral reorganization induced by real-time fMRI feedback training of insula activation a multivariate investigation
    Lee, S; Ruiz, S; Caria, A; Veit, R; Birbaumer, N; Sitaram, R
  • Causality patterns and machine learning for the extraction of problem–action relations in discharge summaries
    Seol, JW; Yi, W; Choi, J; Lee, KS
  • An analysis of Bayesian classifiers
    Langley, P; Iba, W; Thompson, K
  • Event causality extraction based on connectives analysis
    Zhao, S; Liu, T; Zhao, S; Chen, Y; Nie, JY
  • Mining causal relationships among clinical variables for cancer diagnosis based on Bayesian analysis
    Wang, L
  • The WEKA data mining software: an update
    Hall, M; Frank, E; Holmes, G; Pfahringer, B; Reutemann, P; Witten, IH
  • Convolution kernels for natural language
    Collins, M; Duffy, N
  • LIBSVM: a library for support vector machines
    Chang, CC; Lin, CJ