Back to PLS Help

Bootstrapping in behavioral PLS

I'm Online
Laura.Rueda
Posted on 07/30/15 09:22:52
Number of posts: 11
Laura.Rueda posts:

Dear PLS experts,

I've aplied behavioral PLS using EEG data and behavioral data for 3 conditions. The datamat is of size (22subjects * 3 conditions) x (10 elements/sources). The behavioral data is a matrix of (22*3)x 1. From the permutations, the 1st LV is significant. Now I get confused when looking at the bootstrapping results. When checking the correlations of brain scores with behavioral data of LV1, I obtain these values:

result.boot_result.orig_corr(:,1)
0.5748
0.6569
0.3459
 
This shows an increase with the 2nd condition, and then a decrease for the 3rd condition. When checking the CI in result.boot_result.ulcorr(:,1) and result.boot_result.llcorr(:,1), these correlations are stable as the CIs do not cross zero.
 
Then, I check the element that is more reliable and supposed to show this effect more strongly (or that's what I thought it would show). So I check result.boot_result.compare_u(:,1). From this one, only the 2nd element is over 3 (for a CI of 95%). Then I check the correlation of this element (the original data) with the behavioral data, per condition, expecting to find the effect shown in result.boot_result.orig_corr(:,1). However, here's what I obtain:
0.6054
0.5487
0.4816
 
This shows a decreasing trend of correlation with condition (in this case, task difficulty). 
 
I would like to know what the interpretation of this would be, as the most reliable element does not show the effect of the first LV. I'm not sure whether I'm correctly interpreting the variables within the boot_result field. 
 
Any help would be highly appreciated!
 
 
Best regards,

Laura

Replies:

Untitled Post
rmcintosh
Posted on 07/31/15 09:46:47
Number of posts: 394
rmcintosh replies:

Thanks Laura - can you post your results file somewhere so I can take a look at it?  I tend to prefer the confidence intervals over the bootstrap ratios where possible, but I am not sure why you are getting two different patterns of correlations



Untitled Post

I'm Online
Laura.Rueda
Posted on 08/08/15 10:33:54
Number of posts: 11
Laura.Rueda replies:

Hello again,

I've sent the link to the result file by email. To check how stable these results are, I added few more sources. The main difference is that the results are flipped (from a positive to a negative sign), and the trends are flipped: 

result.boot_result.orig_corr(:,1)

c1                c2              c3

-0.6127    -0.7580     -0.4706

The first latent variable is significant. The most stable element is the same as in what I described in my previous message. I already stated the correlation of the raw data and behavior, and there's a decreasing trend (see previous message). So, again I don't see the correlation pattern of the first latent variable, with stable correlations, in the most stable element (based on the bootstrap ratio). 
 
I would greatly appreciate any light in this issue!
 
Cheers,
 
Laura
 
 
 


Untitled Post
rmcintosh
Posted on 08/08/15 10:48:41
Number of posts: 394
rmcintosh replies:

which email address did you use?  I havent received anything yet.  please send to rmcintosh@research.baycrest.org



Untitled Post
rmcintosh
Posted on 08/08/15 11:18:23
Number of posts: 394
rmcintosh replies:

Hi Laura - I checked the correlations in the results file and am not sure how you are calculating the correlations that are different from orig_corr.  Everything i see in the results file is okay

can you please clarify what exacty you are correlating?



Untitled Post

I'm Online
Laura.Rueda
Posted on 08/08/15 11:29:59
Number of posts: 11
Laura.Rueda replies:

Dear Randy,

From the bootstrapping results, the 2nd element has a bootstrap ratio over 3 (as checked from result.boot_result.compare_u(:,1). What I understand is that this element would show more strongly the experimental effect observed in the 1st LV. So I correlate the original data of this element (what I used as an input for the PLS) with behavior. It's in this correlation where I don't see the trend found in the 1st LV. Maybe they shouldn't be similar at all and I'm misinterpreting the results.

Cheers,

Laura

 

 


Untitled Post
rmcintosh
Posted on 08/08/15 11:44:27
Number of posts: 394
rmcintosh replies:

quote:

Dear Randy,

From the bootstrapping results, the 2nd element has a bootstrap ratio over 3 (as checked from result.boot_result.compare_u(:,1). What I understand is that this element would show more strongly the experimental effect observed in the 1st LV. So I correlate the original data of this element (what I used as an input for the PLS) with behavior. It's in this correlation where I don't see the trend found in the 1st LV. Maybe they shouldn't be similar at all and I'm misinterpreting the results.

Cheers,

Laura

 

 

The correlations in the results file are the correlations of the "brain scores" with behavior. The scores are the dot product on the U vector (brainlv) with the orginal data. If you are picking a particular time point in the original data, it may not match orig_corr b/c orig_corr is based on the entire data set (preferentially weighted by the values in U).  The correlations should be similar but not necessarily identical.  

 

From looking at the correlations for LV1, I would be cautious about interpreting the slight differences in the values as reflecting increases or decreases since the confidence intervals for the three conditions overlap.  Basically I would interpret the LV as reflecting common correlations with behavior across tasks.

I hope that makes sense

Randy



Untitled Post

I'm Online
Laura.Rueda
Posted on 08/22/15 11:01:23
Number of posts: 11
Laura.Rueda replies:

Dear Randy,

So I can interpret it as correlations of the brain data with behavioral data as whole (regardless of the condition). Thank you for your help.

 

Cheers,

Laura

 




Login to reply to this topic.

  • Keep in touch

Enter your email above to receive electronic messages from Baycrest, including invitations to programs and events, newsletters, updates and other communications.
You can unsubscribe at any time.
Please refer to our Privacy Policy or contact us for more details.

  • Follow us on social
  • Facebook
  • Instagram
  • Linkedin
  • Pinterest
  • Twitter
  • YouTube

Contact Us:

3560 Bathurst Street
Toronto, Ontario
Canada M6A 2E1
Phone: (416) 785-2500

Baycrest is an academic health sciences centre fully affiliated with the University of Toronto