Abstract
Predicting cryptocurrency prices is inherently difficult due to extreme volatility influenced by market dynamics and investor sentiment. Traditional models often struggle to synthesize short-term fluctuations with long-range temporal dependencies. This study proposes L-FED, a hybrid deep learning architecture that integrates Long Short-Term Memory (LSTM) networks with the FEDformer framework, further enhanced by sentiment analysis. Utilizing a parallel learning structure, L-FED facilitates bidirectional information interaction through local-global collaborative learning. A robust feature engineering process is employed, incorporating historical trade data, technical indicators, and sentiment features alongside LSTM-derived guiding prices. Experimental results indicate that L-FED significantly outperforms baseline models. On Bitcoin and Ethereum datasets, the model achieved RMSE and MAPE improvements of up to 16% and 12.8%, respectively. Furthermore, incorporating the domain-specific CryptoBERT model for sentiment analysis improved predictive accuracy by up to 19%, demonstrating the critical value of specialized linguistic pre-training in capturing market psychology within the highly volatile cryptocurrency ecosystem.
References
S. Nakamoto, “Bitcoin: A peer-to-peer electronic cash system,” Tech. Rep., 2008.
C. Huls, “A scenario planning for interbank payments and decentralized ledger platforms,” Tech. Rep., 2015.
X. Qiao, H. Zhu, and L. Hau, “Time-frequency co-movement of cryptocurrency return and volatility: Evidence from wavelet coherence analysis,” Int. Rev. Financial Anal., vol. 71, Oct. 2020, Art. no. 101541, doi: 10.1016/j.irfa.2020.101541.
L. Catania, S. Grassi, and F. Ravazzolo, “Predicting the volatility of cryptocurrency time-series,” in Mathematical and Statistical Methods for Actuarial Sciences and Finance, 2018, doi: 10.1007/978-3-319-89824-7_37.
S. Bistarelli, F. Santini, and L. M. Tutino, “A short survey on Bitcoin price prediction,” in Proc. 6th Distrib. Ledger Technol. Workshop, May 2024. [Online]. Available: https://ceur-ws.org/Vol-3791/paper26.pdf
P. Pichaiyuth, P. Termnuphan, T. Triyason, O. Rojanapornpun, and S. Jaiyen, “Price trend forecasting of cryptocurrency using multiple technical indicators and SHAP,” in Proc. 20th Int. Joint Conf. Comput. Sci. Softw. Eng. (JCSSE), Jun. 2023, pp. 150–154.
H. Zhao, M. Crane, and M. Bezbradica, “Attention! Transformer with sentiment on cryptocurrencies price prediction,” in Proc. 7th Int. Conf. Complex., Future Inf. Syst. Risk, Apr. 2022, pp. 98–104, doi: 10.5220/0011103400003197.
D. Garcia and F. Schweitzer, “Social signals and algorithmic trading of Bitcoin,” Roy. Soc. Open Sci., vol. 2, no. 9, Sep. 2015, Art. no. 150288, doi: 10.1098/rsos.150288.
T. Walther and T. Klein, “Exogenous drivers of cryptocurrency volatility—A mixed data sampling approach to forecasting,” Tech. Rep., 2018.
T. Guo and N. Antulov-Fantulin, “Predicting short-term Bitcoin price fluctuations from buy and sell orders,” 2018, arXiv.1802.04065.
D. Shah and K. Zhang, “Bayesian regression and Bitcoin,” in Proc. 52nd Annu. Allerton Conf. Commun., Control, Comput. (Allerton), Sep. 2014, pp. 409–414, doi: 10.1109/ALLERTON.2014.7028484.
S. Mcnally, J. Roche, and S. Caton, “Predicting the price of Bitcoin using machine learning,” in Proc. 26th Euromicro Int. Conf. Parallel, Distrib. Netw.-Based Process. (PDP), Jun. 2018, pp. 339–343, doi: 10.1109/pdp2018.2018.00060.
Z. Chen, C. Li, and W. Sun, “Bitcoin price prediction using machine learning: An approach to sample dimension engineering,” J. Comput. Appl. Math., vol. 365, Feb. 2020, Art. no. 112395, doi: 10.1016/j.cam.2019.112395.
P. Boozary, S. Sheykhan, and H. GhorbanTanhaei, “Forecasting the Bitcoin price using the various machine learning: A systematic review in datadriven marketing,” Syst. Soft Comput., vol. 7, Dec. 2025, Art. no. 200209, doi: 10.1016/j.sasc.2025.200209.
S. Das, M. Billah, and S. A. Mumu, “A hybrid approach for predicting Bitcoin price using bi-LSTM and bi-RNN based neural network,” in Intelligent Data Engineering and Automated Learning-IDEAL 2021, 2021, doi: 10.1007/978-3-030-91608-4_23.
E. Koo and G. Kim, “Centralized decomposition approach in LSTM for Bitcoin price prediction,” Expert Syst. Appl., vol. 237, Mar. 2024, Art. no. 121401, doi: 10.1016/j.eswa.2023.121401.
S. Cavalli and M. Amoretti, “CNN-based multivariate data analysis for Bitcoin trend prediction,” Appl. Soft Comput., vol. 101, Mar. 2021, Art. no. 107065, doi: 10.1016/j.asoc.2020.107065.
C. Yin and M. Nisheva-Pavlova, “From features to decisions: Analysis of transformer frameworks for Bitcoin price prediction,” in Proc. IEEE 2nd Int. Conf. Image Process. Comput. Appl. (ICIPCA), Jun. 2024, pp. 427–433, doi: 10.1109/ICIPCA61593.2024.10709269.
Q. Guo, S. Lei, Q. Ye, and Z. Fang, “MRC-LSTM: A hybrid approach of multi-scale residual CNN and LSTM to predict Bitcoin price,” 2021, arXiv:2105.00707.
R. Kaur, M. Uppal, D. Gupta, S. Juneja, S. Y. Arafat, J. Rashid, J. Kim, and R. Alroobaea, “Development of a cryptocurrency price prediction model: Leveraging GRU and LSTM for Bitcoin, Litecoin and Ethereum,” PeerJ Comput. Sci., vol. 11, p. e2675, Mar. 2025, doi: 10.7717/peerj-cs.2675.
M. A. L. Khaniki and M. Manthouri, “Enhancing price prediction in cryptocurrency using transformer neural network and technical indicators,” 2024, arXiv:2403.03606.
A. Chiorrini, C. Diamantini, A. Mircoli, and D. Potena, “Emotion and sentiment analysis of tweets using BERT,” in Proc. EDBT ICDT Workshops, 2021, pp. 1–7.
T. Pano and R. Kashef, “A complete VADER-based sentiment analysis of Bitcoin (BTC) tweets during the era of COVID-19,” Big Data Cognit. Comput., vol. 4, no. 4, p. 33, Nov. 2020, doi: 10.1007/s10489-022-03241-9.
G. Kaur, A. Kaur, M. Khurana, and R. Damasevicius, “Sentiment polarity analysis of love letters: Evaluation of TextBlob, vader, flair, and hugging face transformer,” Comput. Sci. Inf. Syst., vol. 21, no. 4, pp. 1411–1433, 2024.
C. Lamon, E. Nielsen, and E. Redondo, “Cryptocurrency price prediction using news and social media sentiment,” SMU Data Sci. Rev., vol. 1, no. 3, pp. 1–22, 2017.
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” 2018, arXiv:1810.04805.
D. Ider, “Cryptocurrency return prediction using investor sentiment extracted by BERT-based classifiers from news articles, Reddit posts and tweets,” 2022, arXiv.2204.05781.
Z. Liu, D. Huang, K. Huang, Z. Li, and J. Zhao, “FinBERT: A pre-trained financial language representation model for financial text mining,” in Proc. 29th Int. Joint Conf. Artif. Intell., Jul. 2020, pp. 4513–4519, doi: 10.24963/IJCAI.2020/622.
M. Kulakowski and F. Frasincar, “Sentiment classification of cryptocurrency-related social media posts,” IEEE Intell. Syst., vol. 38, no. 4, pp. 5–9, Jul. 2023.
E. Stellwagen and L. Tashman, “ARIMA: The models of box and Jenkins,” Foresight, Int. J. Appl. Forecasting, pp. 28–33, 2013.
T. Bollerslev, “Generalized autoregressive conditional heteroskedasticity,” Eeri Res. Paper, vol. 31, no. 3, pp. 307–327, 1986.
G. Momin, “Bitcoin price prediction using SVM and ARIMA model,” Tech. Rep., 2021, doi: 10.48175/IJARSCT-1486.
P. Katsiampa, “Volatility estimation for Bitcoin: A comparison of GARCH models,” Econ. Lett., vol. 158, pp. 3–6, Sep. 2017.
J. Chu, S. Chan, S. Nadarajah, and J. Osterrieder, “GARCH modelling of cryptocurrencies,” J. Risk Financial Manage., vol. 10, no. 4, p. 17, Oct. 2017, doi: 10.3390/jrfm10040017.
K. Rathan, S. V. Sai, and T. S. Manikanta, “Crypto-currency price prediction using decision tree and regression techniques,” in Proc. 3rd Int. Conf. Trends Electron. Informat. (ICOEI), Apr. 2019, pp. 190–194, doi: 10.1109/ICOEI.2019.8862585.
K. Cortez, M. D. P. Rodríguez-García, and S. Mongrut, “Exchange market liquidity prediction with the K-nearest neighbor approach: Crypto vs. Fiat currencies,” Mathematics, vol. 9, no. 1, p. 56, Dec. 2020, doi: 10.3390/math9010056.
F. Orte, J. Mira, M. J. Sánchez, and P. Solana, “A random forest-based model for crypto asset forecasts in futures markets with out-of-sample prediction,” Res. Int. Bus. Finance, vol. 64, Jan. 2023, Art. no. 101829.
K. Safari, S. Khalfalla, and F. Imani, “Dependency evaluation of defect formation and printing location in additive manufacturing,” in Proc. ASME Int. Mech. Eng. Congr. Expo., 2022, pp. 1–16, doi: 10.1115/imece2022-95145.
J. Elman, “Finding structure in time,” Cognit. Sci., vol. 14, no. 2, pp. 179–211, Jun. 1990, doi: 10.1016/0364-0213(90)90002-E.
S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Comput., vol. 9, no. 8, pp. 1735–1780, Nov. 1997.
Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proc. IEEE, vol. 86, no. 11, pp. 2278–2324, Nov. 1998, doi: 10.1109/5.726791.
K. Cho, “Learning phrase representations using RNN encoder–decoder for statistical machine translation,” Comput. Sci., 2014, doi: 10.3115/v1/D14-1179.
A. Graves and N. Jaitly, “Towards end-to-end speech recognition with recurrent neural networks,” in Proc. Int. Conf. Mach. Learn., 2014, pp. 1764–1772.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” 2017, arXiv.1706.03762.
Z. Zhang, H.-N. Dai, J. Zhou, S. K. Mondal, M. M. García, and H. Wang, “Forecasting cryptocurrency price using convolutional neural networks with weighted and attentive memory channels,” Expert Syst. Appl., vol. 183, Nov. 2021, Art. no. 115378, doi: 10.1016/j.eswa.2021.115378.
P. Peng, Y. Chen, W. Lin, and J. Z. Wang, “Attention-based CNN-LSTM for high-frequency multiple cryptocurrency trend prediction,” Expert Syst. Appl., vol. 237, Mar. 2024, Art. no. 121520.
A. S. Girsang and Stanley, “Hybrid LSTM and GRU for cryptocurrency price forecasting based on social network sentiment analysis using FinBERT,” IEEE Access, vol. 11, pp. 120530–120540, 2023, doi: 10.1109/ACCESS.2023.3324535.
P. L. Seabe, C. R. B. Moutsinga, and E. Pindza, “Sentiment-driven cryptocurrency forecasting: Analyzing LSTM, GRU, bi-LSTM, and temporal attention model (TAM),” Social Netw. Anal. Mining, vol. 15, no. 1, May 2025, doi: 10.1007/s13278-025-01463-6.
T. K. Toai, R. Senkerik, I. Zelinka, A. Ulrich, V. T. X. Hanh, and V. M. Huan, “ARIMA for short-term andLSTM for long-term in daily Bitcoin price prediction,” in Proc. Int. Conf. Artif. Intell. Soft Comput., 2023, pp. 131–141, doi: 10.1007/978-3-031-23492-7_12.
Y. Hua, “Bitcoin price prediction using ARIMA and LSTM,” in Proc. E3S Web Conf., vol. 218, 2020, p. 5, doi: 10.1051/e3sconf/202021801050.
H. Y. Kim and C. H. Won, “Forecasting the volatility of stock price index: A hybrid model integrating LSTM with multiple GARCH-type models,” Expert Syst. Appl., vol. 103, pp. 25–37, Aug. 2018, doi: 10.1016/j.eswa.2018.03.002.
N. Uras, L. Marchesi, M. Marchesi, and R. Tonelli, “Forecasting Bitcoin closing price series using linear regression and neural networks models,” 2020, arXiv:2001.01127.
A. Tanwar and V. Kumar, “Prediction of cryptocurrency prices using transformers and long short term neural networks,” in Proc. Int. Conf. Intell. Controller Comput. Smart Power (ICICCSP), Jul. 2022, pp. 1–4.
S. Ganapathy, R. Canal, D. Alexandrescu, E. Costenaro, A. González, and A. Rubio, “INFORMER: An integrated framework for early-stage memory robustness analysis,” in Proc. Conf. Design Eur. Design Autom. Assoc., Mar. 2014, pp. 1–4, doi: 10.7873/DATE.2014.046.
N. Kitaev, L. Kaiser, and A. Levskaya, “Reformer: The effıcient transformer,” in Proc. Int. Conf. Learn. Represent., 2020.
H. Wu, J. Xu, J. Wang, and M. Long, “Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting,” 2021, arXiv:2106.13008.
T. Zhou, Z. Ma, Q. Wen, X. Wang, L. Sun, and R. Jin, “FEDformer: Frequency enhanced decomposed transformer for long-term series forecasting,” 2022, arXiv:2201.12740.
A. H. B. Gezici and E. Sefer, “Deep transformer-based asset price and direction prediction,” IEEE Access, vol. 12, pp. 24164–24178, 2024.
T. Tuncer, U. Kaya, E. Sefer, O. Alacam, and T. Hoser, “Asset price and direction prediction via deep 2D transformer and convolutional neural networks,” in Proc. 3rd ACM Int. Conf. AI Finance, Nov. 2022, pp. 79–86.
M. Pala and E. Sefer, “NFT price and sales characteristics prediction by transfer learning of visual attributes,” J. Finance Data Sci., vol. 10, Dec. 2024, Art. no. 100148, doi: 10.1016/j.jfds.2024.100148.

