{"id":237,"date":"2022-11-10T23:21:12","date_gmt":"2022-11-10T23:21:12","guid":{"rendered":"http:\/\/michaeltsmith.org.uk\/?p=237"},"modified":"2022-11-11T17:30:12","modified_gmt":"2022-11-11T17:30:12","slug":"infinite-bases-for-eq-kernel","status":"publish","type":"post","link":"http:\/\/michaeltsmith.org.uk\/?p=237","title":{"rendered":"Infinite Bases for EQ kernel"},"content":{"rendered":"

I understand that the EQ kernel (and other kernels) can be understood via the kernel trick as an infinite number of (appropriate) bases functions. I’ve not found the actual proof of this online (I’m sure it’s somewhere, but I clearly didn’t know what to search for [edit: Turns out some of it is in the covariance functions chapter in Gaussian Processes for Machine Learning]). It’s straightforward, but I wanted to see it, so I would know what constants etc I needed my bases to have (lengthscale and height).<\/p>\n

Without loss of generality (hopefully) I’ve just considered the kernel evaluated between \"x\" and \"0\". This should be fine as the EQ kernel is stationary.<\/p>\n

So:<\/p>\n

The EQ kernel: \"k(x,0) = e^{-\frac{x^2}{2l^2}}\"<\/p>\n

We believe that an infinite number of Gaussian bases, \"\phi_a(x) = \left(\frac{l^2 \pi}{2}\right)^{-\frac{1}{4}}e^{-\frac{(x-a)^2}{l^2}}\" will produce the EQ kernel.<\/p>\n

\"mathematical<\/p>\n

For multiple dimensional inputs:<\/p>\n

The EQ kernel: \"k(\mathbf{x},0) = e^{-\sum_i(\frac{x_i}{l_i})^2}\"<\/p>\n

We believe that an infinite number of Gaussian bases, \"\phi_\mathbf{a}(\mathbf{x}) = \prod{l_i}^{-\frac{1}{2}}\left(\frac{\pi}{2}\right)^{-\frac{D}{4}}e^{-\sum_i (\frac{(x_i-a_i)}{l_i})^2}\" will produce the EQ kernel.<\/p>\n","protected":false},"excerpt":{"rendered":"

I understand that the EQ kernel (and other kernels) can be understood via the kernel trick as an infinite number of (appropriate) bases functions. I’ve not found the actual proof of this online (I’m sure it’s somewhere, but I clearly didn’t know what to search for [edit: Turns out some of it is in the … <\/p>\n

Continue reading “Infinite Bases for EQ kernel”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-237","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"http:\/\/michaeltsmith.org.uk\/index.php?rest_route=\/wp\/v2\/posts\/237","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/michaeltsmith.org.uk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/michaeltsmith.org.uk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/michaeltsmith.org.uk\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/michaeltsmith.org.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=237"}],"version-history":[{"count":11,"href":"http:\/\/michaeltsmith.org.uk\/index.php?rest_route=\/wp\/v2\/posts\/237\/revisions"}],"predecessor-version":[{"id":252,"href":"http:\/\/michaeltsmith.org.uk\/index.php?rest_route=\/wp\/v2\/posts\/237\/revisions\/252"}],"wp:attachment":[{"href":"http:\/\/michaeltsmith.org.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=237"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/michaeltsmith.org.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=237"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/michaeltsmith.org.uk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=237"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}