kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Scale-Invariant and consistent Bayesian information criterion for order selection in linear regression models
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering.
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering.ORCID iD: 0000-0002-6855-5868
2022 (English)In: Signal Processing, ISSN 0165-1684, E-ISSN 1872-7557, Vol. 196, article id 108499Article in journal (Refereed) Published
Abstract [en]

The Bayesian information criterion (BIC) is one of the most well-known criterion used for model order estimation in linear regression models. However, in its popular form, BIC is inconsistent as the noise variance tends to zero given that the sample size is small and fixed. Several modifications of the original BIC have been proposed that takes into account the high-SNR consistency, but it has been recently observed that the performance of the high-SNR forms of BIC highly depends on the scaling of the data. This scaling problem is a byproduct of the data dependent penalty design, which generates irregular penalties when the data is scaled and often leads to greater underfitting or overfitting losses in some scenarios when the noise variance is too small or large. In this paper, we present a new form of the BIC for order selection in linear regression models where the parameter vector dimension is small compared to the sample size. The proposed criterion eliminates the scaling problem and at the same time is consistent for both large sample sizes and high-SNR scenarios.

Place, publisher, year, edition, pages
Elsevier BV , 2022. Vol. 196, article id 108499
Keywords [en]
BIC, Consistency, Linear regression, Model order selection, Scale-invariant
National Category
Probability Theory and Statistics Signal Processing
Identifiers
URN: urn:nbn:se:kth:diva-311634DOI: 10.1016/j.sigpro.2022.108499ISI: 000782990100004Scopus ID: 2-s2.0-85126112427OAI: oai:DiVA.org:kth-311634DiVA, id: diva2:1655241
Funder
EU, European Research Council, 742648
Note

QC 20220530

Available from: 2022-05-02 Created: 2022-05-02 Last updated: 2022-06-25Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Borpatra Gohain, PrakashJansson, Magnus

Search in DiVA

By author/editor
Borpatra Gohain, PrakashJansson, Magnus
By organisation
Information Science and Engineering
In the same journal
Signal Processing
Probability Theory and StatisticsSignal Processing

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 115 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf