Another way to put this, the regular (lm) regression indicates that the more friends a student has, the happier they are, but looking closer this is not the case in all schools (and is, in fact, the opposite in some). These are considered fixed because they take on a predetermined set of values. SAS/SPSS uses Satterthwaite approximations. Thus, we will compare whether the addition of the random slopes to the random-intercepts model results in an improved fit. Finally, I highly recommend the textbook chapter on multilevel models in Cohen, Cohen, West and Aiken (2013) and the entire textbook by Gelman and Hill (2006). Instead of one general random-effect that captures how each observation deviates from the predicted fixed-effects, there will be multiple random-effects that capture how observations deviate within a cluster, and how each cluster deviates from the overall group. We examine the intra-class correlation (ICC) to determine if multi-level modeling is the correct choice for our analysis. Most of the examples found in the Mplus section can be run using the demo version. It is a positive correlation as well, but only poor schools (those with more students) had a positive correlation. install.packages(“texreg”) # Allows you to save tables. Not properly controlling for these differences, which you may often not know are there, will increase your chance of Type I error. Thus, while this 25 ms difference was not significant using OLS regression, it is significant in a MLM. In our example, this would indicate variability in the time participants took to begin speaking in English, but a constant relationship between the response language and the time. Chapter 9: Multilevel modeling with complex survey data view examples Description. By controlling for the variability in the time to speak due to each subject’s different baselines (i.e., random-intercepts), the remaining variability indicated a significant fixed-effect of language across individuals. She is interested in whether a matching or mismatching response language will affect the time it takes to begin the utterance. In addition, there is also the fixed-effect regression (solid line) that captures the overall group effect. Instead, observations from the same individual are likely to be “clustered,” and a MLM adds some extra parameters that control for this clustering. For instance, individuals may be nested within workgroups, or repeated measures may be nested within individuals. We wondered if happiness could be predicted by number of friends and/or GPA. A different intercept is estimated for each participant (dotted lines), assuming the same slope for all participants. Linear models and linear mixed effects models in R with linguistic applications. Cambridge, England: Cambridge University Press. In ordinary least squares (OLS) regression, we would model this data using the following formula: For each case, the “Time” score can be separated into fixed and random effects. Now that we specified our random effects, we can test whether the fixed effect of language is significant. Tutorials in Quantitative Methods for Psychology, 8(1): 52-69. For example, since we only used three color words out of the entire population of possible color words, we might use the items as another random-effect to control for “by-item” variability. In this case, Level 1 is the students. From this simple example, we can easily scale up our model. Data analysis using regression and multilevel/hierarchical models. Baayen et al. Either are acceptable. Peugh, J.L. Our ICC is greater than 0, meaning we were correct to think of this as a multi-level problem. The goal of multi-level modeling is to draw a conclusion about the general sample that you have while controlling for differences you are not trying to explain (in this example, rich vs. poor). (2011) provide excellent in-depth discussions. To assess whether the addition of the random-slopes improved the fit of our model, we can use a goodness of fit test known as a likelihood ratio (LR) chi-square difference test (i.e., nested model test; Snijders & Bosker, 2012). Although mathematically sophisticated, MLMs are easy to use once familiar with some basic concepts. If we knew this information, we would put SES as another Level 2 predictor. In the left-hand portion of the figure below, we can see a graphical representation of this random-intercepts model. We may also have reason to believe that the relationship between time to speak and the response language might differ for each individual, in addition to the baseline differences. (2008). An example Mumper, M. (2017, January). Thus, we will create a model with only an intercept as a fixed effect, and compare it to our random-intercepts model. (2006). The fixed effects include the intercept (B0) and the slope (B1) for the dichotomous independent variable "Language." Applied multiple regression/correlation analysis for the behavioral sciences (3rd Ed.). Journal of Experimental Psychology: General, 143(5), 2020-2045. Beyond Multiple Linear Regression: Applied Generalized Linear Models and Multilevel Models in R (R Core Team 2020) is intended to be accessible to undergraduate students who have successfully completed a regression course through, for example, a textbook like Stat2 (Cannon et al. Notice how the correlation between Friends and Happiness has changed when you collapse across all rich and poor schools. This will be important. That brings our assumed R=3 down to about 1.2. The expression (B0 + B1 * Language|Subject) tells the model to estimate different intercepts and slopes for each individual, as shown in the right-hand portion of the figure below. Multilevel models (MLMs, also known as linear mixed models, hierarchical linear models or mixed-effect models) have become increasingly popular in psychology for analyzing data with repeated measurements or data organized in nested levels (e.g., students in classrooms). SO, Let’s try running this as a multilevel, random effects model: Using a multi-level model allows us to separate the within-group effects from the between-group effects, whereas regular regression blends them together into a single coefficient. The result is significant ((X(1) = 3.96, p < .05), suggesting that the addition of the fixed-effect of language improves model fit. The Quantitative Methods for Psychology, 10(1): 13- 28. (2008) and West et al. Uh-oh. Westfall, J., Kenny, D. A., & Judd, C. M. (2014). The issue with this approach is that we repeatedly sampled from the same individual, and this violates the OLS assumption that observations are independent from each other. Baayen et al. If you were trying to generalize your findings or use them to argue for/show a need for an intervention, your results would be misleading and could cause problems. (2006). Great, our correlation between Friends and Happiness is -.76 and we have a correlation between GPA and Happiness of -.05. Therefore, students who received initial instruction in SEM with lavaan should have little di culty using other (commercial) SEM programs in the future. In the present example, our MLM gave us a more accurate interpretation - that no main effect of Friends existed for all schools generally. you will need to refit the models with the package lmerTest installed and loaded. The ICC measures the degree of clustering in our data and answers the question, “How much does my Level 2 predict the total variance of my study?” If your ICC is greater than 0, you have a multi-level study. We find an intercept of 522.11 and a slope of -24.89, suggesting that participants took about 522 ms to begin speaking when responding in English, but began speaking 25 ms faster when responding in Spanish. NOTE: Although I am telling you that some schools are rich and some are poor, you may not know this information when you come in and try to do the analysis. Multilevel data occur when observations are nested within groups, for example, when students are nested within schools in a district. We can include more predictors at both the micro-level and macro-level, which can be used as random slopes, and can even interact (a cross-level interaction). Winter, B. Retrieved from http://arxiv.org/pdf/1308.5499.pdf (PDF, 2.69MB). We estimate the variability for each random-effect and use that to control for the variance when estimating the significance our fixed-effects. An introduction to hierarchical linear modeling. Multilevel analyses are applied to data that have some form of a nested structure. That’s a huge reduction, but 1.2 is still bigger than 1: it means that the epidemic will double every 3 weeks. We can also have nested random effects. Our model would then include a (B0│Subject)+(B0 |Item) for random intercepts by-subject and by-item. Baayen, R.H., Davidson, D.J., & Bates, D.M. COVID-19 resources for psychologists, health-care workers and the public. Modeling Longitudinal Data by Robert Weiss; Logistic Regression and Related Methods Applied Logistic Regression (Second Edition) by David Hosmer and Stanley Lemeshow; An Introduction to Categorical Data Analysis by Alan Agresti; Multilevel Modeling Introduction to Multilevel Modeling by … Introductions to using MLMs are available for R (Winters, 2013), SPSS (Hayes, 2006), and SAS (Peugh, 2010). Statistical power and optimal design in experiments in which samples of participants respond to samples of stimuli. To do so, we create a base model that is identical to the original model minus the effect of interest. A practical guide to multilevel modeling. In this primer, I use a simple example to demonstrate the fundamental principles of MLMs. What could bring R below 1, short of a full-scale lockdown? Thus, I highly encourage you to continue learning about MLMs. Baayen, R.H., Davidson, D.J., & Bates, D.M. Our regression equation now looks like: Timei = B0 + B1 * Languagei + (B0|Subject) + ei. Multilevel modelling. (2013). The color words are always presented in English. Also, I am only using six schools to demonstrate, but in a more “normal” case of nested design there may be way too many schools to treat SES as a fixed factor in the design. Let’s test if these formulas work with an example from each set of schools (one rich and one poor). Base Model: Timei = B0 + (B0|Subject) +ei, Random Intercepts: Timei = B0 + B1* Languagei + (B0|Subject) +ei. In other words, this formula indicates that there are multiple responses per subject, and that each response will depend on that subject’s baseline. PSA is the monthly e-newsletter of the APA Science Directorate. This flexibility makes MLM an attractive option for researchers. Call for Papers/Proposals/Nominations (4), © 2021 American Psychological Association. One solution is to estimate degrees of freedom to get p-values. Thus, the random-intercept model appears to be the best fit. This combination of different “levels” of analysis gives rise to the term multi-level modeling. This is accomplished using an LR test too. (2011) provide excellent in-depth discussions. Now we have a positive, significant effect of Friends and no effect of GPA. arXiv:1308.5499. Rich schools have r = -.76 and poor schools have r = .77. However, in our mixed (lmer) regression, Friends had a larger (2.16), but non-significant effect. Returning to our example, we are going to add a random-effect for “Subject” that characterizes each participant’s idiosyncratic variation from the fixed-effect estimates. Let’s try running a normal regression on all the data at once. Now let’s see what happens if you run a normal regression on rich and poor schools separately. This is known as a random-intercepts model, because we are going to estimate a different intercept for each subject. Thus, we can model our data at the observation level (micro-level) and at the cluster level (macro-level). The regular regression did not reflect what was happening in each school type. If you want to report main effects and interactions instead of slopes, you might convert your mixed model into an ANOVA. In our regular (lm) regression, Friends had a significant effect, b = 1.40 (p < .001). Our model will control for this within-cluster variance and test the fixed-effect estimates against the remaining between-cluster variance. LS0tDQp0aXRsZTogIkNoYXB0ZXIgMTY6IE11bHRpbGV2ZWwgTW9kZWxpbmciDQphdXRob3I6ICJUZXJlc2EgRy4gQm9yb3dza2kiDQpvdXRwdXQ6DQogIGh0bWxfZG9jdW1lbnQ6DQogICAgdGhlbWU6IGNlcnVsZWFuDQogICAgaGlnaGxpZ2h0OiB0ZXh0bWF0ZQ0KICAgIGZvbnRzaXplOiA4cHQNCiAgICB0b2M6IHRydWUNCiAgICBudW1iZXJfc2VjdGlvbnM6IHRydWUNCiAgICBjb2RlX2Rvd25sb2FkOiB0cnVlDQogICAgdG9jX2Zsb2F0Og0KICAgICAgY29sbGFwc2VkOiBmYWxzZQ0KLS0tDQoNCmBgYHtyIHNldHVwLCBpbmNsdWRlPUZBTFNFfQ0Ka25pdHI6Om9wdHNfY2h1bmskc2V0KGVjaG8gPSBUUlVFKQ0Ka25pdHI6Om9wdHNfY2h1bmskc2V0KG1lc3NhZ2UgPSBGQUxTRSkNCmtuaXRyOjpvcHRzX2NodW5rJHNldCh3YXJuaW5nID0gRkFMU0UpDQprbml0cjo6b3B0c19jaHVuayRzZXQoZmlnLndpZHRoPTUpDQprbml0cjo6b3B0c19jaHVuayRzZXQoZmlnLmhlaWdodD0zLjc1KQ0Ka25pdHI6Om9wdHNfY2h1bmskc2V0KGZpZy5hbGlnbj0nY2VudGVyJykgDQpgYGANCg0KIyBQcmVwcGluZyB5b3VyIFINCg0KIyNQYWNrYWdlcyB5b3Ugd2lsbCBuZWVkOg0KDQotIGluc3RhbGwucGFja2FnZXMoImxtZTQiKSAjIEFsbG93cyB5b3UgdG8gZml0IGxpbmVhciBtaXhlZC1lZmZlY3RzIG1vZGVscy4NCi0gaW5zdGFsbC5wYWNrYWdlcygiZWZmZWN0cyIpICMgSGVscHMgeW91IHZpc3VhbGl6ZSBpbnRlcmFjdGlvbnMNCi0gaW5zdGFsbC5wYWNrYWdlcygiY29ycnBsb3QiKSAjIEhlbHBzIHlvdSB0byB2aXN1YWxpemUgY29ycmVsYXRpb25zIA0KLSBpbnN0YWxsLnBhY2thZ2VzKCJzdGFyZ2F6ZXIiKSAjIE1ha2VzIHRhYmxlcw0KLSBpbnN0YWxsLnBhY2thZ2VzKCJjYXIiKSAjIEhlbHBzIHdpdGggRGlhZ25vc3RpY3MNCi0gaW5zdGFsbC5wYWNrYWdlcygiTUFTUyIpICMgRm9yIHN0ZXB3aXNlIHJlZ3Jlc3Npb24NCi0gaW5zdGFsbC5wYWNrYWdlcygiZ2dwbG90MiIpICMgVG8gY3JlYXRlIHBsb3RzDQotIGluc3RhbGwucGFja2FnZXMoInRleHJlZyIpICMgQWxsb3dzIHlvdSB0byBzYXZlIHRhYmxlcy4NCg0KIyNMb2FkIHRoZSBsaWJyYXJpZXMgeW91IG5lZWQuDQoNCmBgYHtyfQ0KbGlicmFyeShsbWU0KQ0KbGlicmFyeShlZmZlY3RzKQ0KbGlicmFyeShjb3JycGxvdCkNCmxpYnJhcnkoc3RhcmdhemVyKQ0KbGlicmFyeShjYXIpDQpsaWJyYXJ5KE1BU1MpDQpsaWJyYXJ5KGdncGxvdDIpDQpsaWJyYXJ5KHRleHJlZykNCmBgYA0KDQoNCiMgVGhlIERhdGEgU2V0Og0KDQpUaGlzIGlzIGEgc3BlY2lhbCB0eXBlIG9mIGRhdGEgd2hlcmUgdGhlcmUgaXMgb25seSBvbmUgbWVhc3VyZW1lbnQgcGVyIHN0dWRlbnQgKGkuZS4sIHRoZXJlIGlzIG5vIHdpdGhpbiBzdWJqZWN0IHZhcmlhYmxlKSwgYW5kIHN0dWRlbnRzIGFyZSBuZXN0ZWQgaW4gc2Nob29scyBzbyB3ZSBtdXN0IGNvbnRyb2wgZm9yIHRoZSBlZmZlY3RzIG9mIHNjaG9vbHMuIA0KDQpNdWx0aWxldmVsIGRhdGEgb2NjdXIgd2hlbiBvYnNlcnZhdGlvbnMgYXJlIG5lc3RlZCB3aXRoaW4gZ3JvdXBzLCBmb3IgZXhhbXBsZSwgd2hlbiBzdHVkZW50cyBhcmUgbmVzdGVkIHdpdGhpbiBzY2hvb2xzIGluIGEgZGlzdHJpY3QuDQoNCk91ciBzaW1wbGUgc3RvcnkgLQ0KDQpXZSBsb29rZWQgYXQgNiBzY2hvb2xzICgzIHJpY2ggYW5kIDMgcG9vcikgd2l0aCA0MCBzdHVkZW50cyBpbiBlYWNoIHJpY2ggc2Nob29sIGFuZCAxNjAgc3R1ZGVudHMgaW4gZWFjaCBwb29yIHNjaG9vbCwgYW5kIHdlIG1lYXN1cmVkIHRoZW0gb24gSGFwcGluZXNzLCBudW1iZXIgb2YgRnJpZW5kcywgYW5kIEdQQS4gV2Ugd29uZGVyZWQgaWYgaGFwcGluZXNzIGNvdWxkIGJlIHByZWRpY3RlZCBieSBudW1iZXIgb2YgZnJpZW5kcyBhbmQvb3IgR1BBLg0KDQpPdXIgTGV2ZWwgMSB3aWxsIGJlIHRoZSBsb3dlc3QgdW5pdCBvZiBvYnNlcnZhdGlvbiAtIHRob3NlIG5lc3RlZCBpbiBncm91cHMuIEluIHRoaXMgY2FzZSwgTGV2ZWwgMSBpcyB0aGUgc3R1ZGVudHMuDQoNCk91ciBMZXZlbCAyIHJlZmVycyB0byB0aGUgZ3JvdXBzIGluIHdoaWNoIHRoZSBsZXZlbCAxIHVuaXRzIGFyZSBuZXN0ZWQ7IGluIHRoaXMgY2FzZSBMZXZlbCAyIGlzIHRoZSBzY2hvb2xzLg0KDQojIyBTaW11bGF0aW5nIHRoZSBEYXRhc2V0Og0KDQojIyMgTWFrZSB5b3VyIGVxdWF0aW9ucw0KQ3JlYXRlIGEgZGlzdHJpYnV0aW9uIGZvciBlYWNoIHNjaG9vbCwgbWFraW5nIHRoZSB2YXJpYW5jZSBvZiByaWNoIHNjaG9vbHMgc21hbGwgYW5kIHRoZSB2YXJpYW5jZSBvZiBwb29yIHNjaG9vbHMgbGFyZ2UuIFdlJ3ZlIGFsc28gbWFkZSB0aGUgZXF1YXRpb25zIGRpZmZlcmVudCBzbyB0aGF0IG91ciBYIChudW1iZXIgb2YgZnJpZW5kcykgY29lZmZpY2llbnQgaXMgbmVnYXRpdmUgaW4gcmljaCBzY2hvb2xzIGJ1dCBwb3NpdGl2ZSBpbiB0aGUgcG9vciBzY2hvb2xzLiBXZSBrZWVwIG91ciBaIChHUEEpIGNvZWZmaWNpZW50IHRoZSBzYW1lIGZvciBhbGwgc2Nob29scy4gDQoNCmBgYHtyfQ0Kc2V0LnNlZWQoNDIpDQpucmljaD00MA0KbnBvb3I9MTYwDQojUGFyYW1hdGVycw0KUy5GLlJpY2g9LTIgIyBzZXR0aW5nIHBhcmFtYWV0ZXJzIGZvciB0aGUgRnJpZW5kcyB2YXJpYWJsZSBpbiB0aGUgUmljaCBzY2hvb2xzDQpTLkYuUG9vcj02ICMgc2V0dGluZyBwYXJhbWV0ZXJzIGZvciB0aGUgRnJpZW5kcyB2YXJpYWJsZSBpbiB0aGUgUG9vciBzY2hvb2xzDQoNClMuRy5SaWNoPS43ICMgc2V0dGluZyBwYXJhbWV0ZXJzIGZvciB0aGUgR1BBIHZhcmlhYmxlIGluIHRoZSBSaWNoIHNjaG9vbHMNClMuRy5Qb29yPS43ICMgc2V0dGluZyBwYXJhbWV0ZXJzIGZvciB0aGUgR1BBIHZhcmlhYmxlIGluIHRoZSBQb29yIHNjaG9vbHMNCiMgUmljaCBTY2hvb2xzDQojIFNjaG9vbCAxDQpYMSA8LSBybm9ybShucmljaCwgMTAsIDIpICMgbnVtYmVyIG9mIGZyaWVuZHMNCloxIDwtIHJ1bmlmKG5yaWNoLCAxLjAsIDQuMCkgIyBHUEENClkxIDwtIFMuRi5SaWNoKlgxICsgUy5HLlJpY2gqWjEgKyA4MCArIHJub3JtKG5yaWNoLCBzZD0gNSkgIyBPdXIgZXF1YXRpb24gdG8gY3JlYXRlIFkNCg0KIyBTY2hvb2wgMg0KWDIgPC0gcm5vcm0obnJpY2gsIDEwLCAyKSAjIG51bWJlciBvZiBmcmllbmRzDQpaMiA8LSBydW5pZihucmljaCwgMS4wLCA0LjApICMgR1BBDQpZMiA8LSBTLkYuUmljaCpYMiArIFMuRy5SaWNoKloyICsgNzUgKyBybm9ybShucmljaCwgc2Q9IDUpDQoNCiMgU2Nob29sIDMNClgzIDwtIHJub3JtKG5yaWNoLCAxMCwgMikgIyBudW1iZXIgb2YgZnJpZW5kcw0KWjMgPC0gcnVuaWYobnJpY2gsIDEuMCwgNC4wKSAjIEdQQQ0KWTMgPC0gUy5GLlJpY2gqWDMgKyBTLkcuUmljaCpaMyArOTAgKyBybm9ybShucmljaCwgc2Q9IDUpDQoNCiMgUG9vciBTY2hvb2xzDQojIFNjaG9vbCA0DQpYNCA8LSBybm9ybShucG9vciwgNSwgMikgI251bWJlciBvZiBmcmllbmRzDQpaNCA8LSBydW5pZihucG9vciwgMS4wLCA0LjApICNHUEENClk0IDwtIFMuRi5Qb29yKlg0ICsgUy5HLlBvb3IqWjQgKyAzNSArIHJub3JtKG5wb29yLCBzZCA9IDEwKQ0KDQojIFNjaG9vbCA1DQpYNSA8LSBybm9ybShucG9vciwgNSwgMikgI251bWJlciBvZiBmcmllbmRzDQpaNSA8LSBydW5pZihucG9vciwgMS4wLCA0LjApICNHUEENClk1IDwtIFMuRi5Qb29yKlg1ICsgUy5HLlBvb3IqWjUgKyA0MCArIHJub3JtKG5wb29yLCBzZCA9IDEwKQ0KDQojIFNjaG9vbCA2DQpYNiA8LSBybm9ybShucG9vciwgNSwgMikgI251bWJlciBvZiBmcmllbmRzDQpaNiA8LSBydW5pZihucG9vciwgMS4wLCA0LjApICNHUEENClk2IDwtIFMuRi5Qb29yKlg2ICsgUy5HLlBvb3IqWjYgKyA1MCArIHJub3JtKG5wb29yLCBzZCA9IDEwKQ0KDQpgYGAgDQoNCiMjIyBNYWtlIHlvdXIgZGF0YSBmcmFtZXMNCk5vdyB0aGF0IHdlIGhhdmUgb3VyIGVxdWF0aW9ucywgd2UncmUgZ29pbmcgdG8gY3JlYXRlIHRoZSBkYXRhIGZyYW1lIGZvciBlYWNoIHNjaG9vbC4NCg0KYGBge3J9DQojIFRoZSAzIFJpY2ggU2Nob29sczoNClN0dWRlbnQuRGF0YS5TY2hvb2wuMTwtZGF0YS5mcmFtZShIYXBwaW5lc3M9WTEsIEZyaWVuZHM9WDEsIEdQQT1aMSkNClN0dWRlbnQuRGF0YS5TY2hvb2wuMjwtZGF0YS5mcmFtZShIYXBwaW5lc3M9WTIsIEZyaWVuZHM9WDIsIEdQQT1aMikNClN0dWRlbnQuRGF0YS5TY2hvb2wuMzwtZGF0YS5mcmFtZShIYXBwaW5lc3M9WTMsIEZyaWVuZHM9WDMsIEdQQT1aMykNCg0KIyBUaGUgMyBQb29yIFNjaG9vbHM6DQpTdHVkZW50LkRhdGEuU2Nob29sLjQ8LWRhdGEuZnJhbWUoSGFwcGluZXNzPVk0LCBGcmllbmRzPVg0LCBHUEE9WjQpDQpTdHVkZW50LkRhdGEuU2Nob29sLjU8LWRhdGEuZnJhbWUoSGFwcGluZXNzPVk1LCBGcmllbmRzPVg1LCBHUEE9WjUpDQpTdHVkZW50LkRhdGEuU2Nob29sLjY8LWRhdGEuZnJhbWUoSGFwcGluZXNzPVk2LCBGcmllbmRzPVg2LCBHUEE9WjYpDQoNCmBgYA0KDQojIyMgVGVzdGluZyB0aGUgZm9ybXVsYXMNCkxldCdzIHRlc3QgaWYgdGhlc2UgZm9ybXVsYXMgd29yayB3aXRoIGFuIGV4YW1wbGUgZnJvbSBlYWNoIHNldCBvZiBzY2hvb2xzIChvbmUgcmljaCBhbmQgb25lIHBvb3IpLg0KDQpgYGB7cn0NCiMgUmljaCAtIFNjaG9vbCAxDQpjb3JyLnN0dWRlbnQgPSBjb3IoU3R1ZGVudC5EYXRhLlNjaG9vbC4xKQ0KY29ycnBsb3QoY29yci5zdHVkZW50LCBtZXRob2QgPSAibnVtYmVyIixkaWFnID0gRkFMU0UsdHlwZSA9ICJsb3dlciIpDQpgYGANCg0KR3JlYXQsIG91ciBjb3JyZWxhdGlvbiBiZXR3ZWVuIEZyaWVuZHMgYW5kIEhhcHBpbmVzcyBpcyAtLjc2IGFuZCB3ZSBoYXZlIGEgY29ycmVsYXRpb24gYmV0d2VlbiBHUEEgYW5kIEhhcHBpbmVzcyBvZiAtLjA1Lg0KDQpgYGB7cn0NCiMgUG9vciAtIFNjaG9vbCA0DQpjb3JyLnN0dWRlbnQgPSBjb3IoU3R1ZGVudC5EYXRhLlNjaG9vbC40KQ0KY29ycnBsb3QoY29yci5zdHVkZW50LCBtZXRob2QgPSAibnVtYmVyIixkaWFnID0gRkFMU0UsdHlwZSA9ICJsb3dlciIpDQpgYGANCg0KR3JlYXQsIG91ciBjb3JyZWxhdGlvbiBiZXR3ZWVuIEZyaWVuZHMgYW5kIEhhcHBpbmVzcyBpcyAuNzcsIHdoaWNoIGlzIGhpZ2hlciBBTkQgaW4gdGhlIG9wcG9zaXRlIGRpcmVjdGlvbiB0aGFuIGluIHJpY2ggc2Nob29scy4gVGhlcmUgd2FzIG5vIGNvcnJlbGF0aW9uIGJldHdlZW4gR1BBIGFuZCBIYXBwaW5lc3MuDQoNClBheSBhdHRlbnRpb24gdG8gdGhlIGZhY3QgdGhhdCB0aGUgc2Nob29scyBoYXZlIGRpZmZlcmVudCBjb3JyZWxhdGlvbiB2YWx1ZXMgZm9yIEZyaWVuZHMgYW5kIEhhcHBpbmVzcyBkZXBlbmRpbmcgb24gaWYgdGhleSdyZSByaWNoIG9yIHBvb3IuIFJpY2ggc2Nob29scyBoYXZlIHIgPSAtLjc2IGFuZCBwb29yIHNjaG9vbHMgaGF2ZSByID0gLjc3LiBGb3IgR1BBIGFuZCBIYXBwaW5lc3MsIG9ubHkgdGhlIHJpY2ggc2Nob29sIGhhZCBhIGNvcnJlbGF0aW9uLiBUaGlzIHdpbGwgYmUgaW1wb3J0YW50LiANCg0KTk9URTogQWx0aG91Z2ggSSBhbSB0ZWxsaW5nIHlvdSB0aGF0IHNvbWUgc2Nob29scyBhcmUgcmljaCBhbmQgc29tZSBhcmUgcG9vciwgeW91IG1heSBub3Qga25vdyB0aGlzIGluZm9ybWF0aW9uIHdoZW4geW91IGNvbWUgaW4gYW5kIHRyeSB0byBkbyB0aGUgYW5hbHlzaXMuIElmIHdlIGtuZXcgdGhpcyBpbmZvcm1hdGlvbiwgd2Ugd291bGQgcHV0IFNFUyBhcyBhbm90aGVyIExldmVsIDIgcHJlZGljdG9yLiANCg0KDQojIyMgUHV0ICdlbSB0b2dldGhlciBhbmQgd2hhdCBoYXZlIHlvdSBnb3QhPw0KTm93IHRoYXQgd2Uga25vdyB0aGV5IHdvcmssIGxldCdzIHB1dCBhbGwgc2Nob29scyB0b2dldGhlciBpbnRvIG9uZSBkYXRhc2V0LiANCg0KYGBge3J9DQpBbGwuU2Nob29scy5EYXRhIDwtIHJiaW5kKFN0dWRlbnQuRGF0YS5TY2hvb2wuMSwgU3R1ZGVudC5EYXRhLlNjaG9vbC4yLCBTdHVkZW50LkRhdGEuU2Nob29sLjMsIFN0dWRlbnQuRGF0YS5TY2hvb2wuNCwgU3R1ZGVudC5EYXRhLlNjaG9vbC41LCBTdHVkZW50LkRhdGEuU2Nob29sLjYpIA0KaGVhZChBbGwuU2Nob29scy5EYXRhKQ0KYGBgDQoNCiMjIyBBZGRpbmcgU3R1ZGVudCBhbmQgU2Nob29sIFZhcmlhYmxlcw0KTm93IGxldCdzIGFkZCBpbiBTdHVkZW50IElEJ3MgYW5kIHRoZSBTY2hvb2xzIGFzIHZhcmlhYmxlcy4NCg0KYGBge3J9DQojIEFkZGluZyB0aGUgc3ViamVjdCB2YXJpYWJsZSAoU3R1ZGVudCBJRCkNCkFsbC5TY2hvb2xzLkRhdGEkU3R1ZGVudElEPC1zZXEoMTpucm93KEFsbC5TY2hvb2xzLkRhdGEpKQ0KIyBEaWQgaXQgd29yaz8NCmhlYWQoQWxsLlNjaG9vbHMuRGF0YSkNCiMgWWVzIQ0KDQojIEFkZGluZyB0aGUgU2Nob29sIHZhcmlhYmxlLiANCkFsbC5TY2hvb2xzLkRhdGEkU2Nob29sPC1jKHJlcCgxLCBucmljaCksIHJlcCgyLG5yaWNoKSwgcmVwKDMsIG5yaWNoKSwgcmVwKDQsIG5wb29yKSwgDQogICAgICAgICAgICAgICAgICAgICAgICAgICByZXAoNSwgbnBvb3IpLCByZXAoNiwgbnBvb3IpKQ0KYGBgDQoNCiMjIyBUZXN0IHRoZSBmdWxsIGRhdGFzZXQNCkxldCdzIHNlZSB3aGF0IHRoZSBzY2F0dGVyIHBsb3RzIGZvciBlYWNoIHNjaG9vbC4NCg0KLSBTY2hvb2xzIDEtMyBhcmUgcmljaGFuZCBzY2hvb2xzIDQtNiBhcmUgcG9vci4NCg0KDQojIFBsb3R0aW5nIA0KDQpOb3cgbGV0J3MgcGxvdCB1cCByYXcgZGF0YS4NCg0KRmlyc3QsIGxldCdzIHBsb3Qgd2l0aCBGcmllbmRzIGFzIG91ciBJVi4NCg0KYGBge3J9DQp0aGVtZV9zZXQodGhlbWVfYncoYmFzZV9zaXplID0gMTIsIGJhc2VfZmFtaWx5ID0gIiIpKSANCg0KIyBGcmllbmRzDQpNb2RlbC5QbG90LkZyaWVuZHMgPC1nZ3Bsb3QoZGF0YSA9IEFsbC5TY2hvb2xzLkRhdGEsIGFlcyh4ID0gRnJpZW5kcywgeT1IYXBwaW5lc3MsZ3JvdXA9U2Nob29sKSkrCQ0KICBmYWNldF9ncmlkKCB+IFNjaG9vbCkrCQ0KICBnZW9tX3BvaW50KGFlcyhjb2xvdXIgPSBTY2hvb2wpKSsJDQogIGdlb21fc21vb3RoKG1ldGhvZCA9ICJsbSIsIHNlID0gVFJVRSwgYWVzKGNvbG91ciA9IFNjaG9vbCkpKwkNCiAgeGxhYigiRnJpZW5kcyIpK3lsYWIoIkhhcHBpbmVzcyIpKwkNCiAgdGhlbWUobGVnZW5kLnBvc2l0aW9uID0gIm5vbmUiKQkNCk1vZGVsLlBsb3QuRnJpZW5kcwkNCmBgYA0KDQpOb3csIGxldCdzIHBsb3Qgd2l0aCBHUEEgYXMgb3VyIElWLg0KDQpgYGB7cn0NCk1vZGVsLlBsb3QuR1BBIDwtZ2dwbG90KGRhdGEgPSBBbGwuU2Nob29scy5EYXRhLCBhZXMoeCA9R1BBLCB5PUhhcHBpbmVzcyxncm91cD1TY2hvb2wpKSsJDQogIGZhY2V0X2dyaWQoIH4gU2Nob29sKSsJDQogIGdlb21fcG9pbnQoYWVzKGNvbG91ciA9IFNjaG9vbCkpKwkNCiAgZ2VvbV9zbW9vdGgobWV0aG9kID0gImxtIiwgc2UgPSBUUlVFLCBhZXMoY29sb3VyID0gU2Nob29sKSkrCQ0KICB4bGFiKCJHUEEiKSt5bGFiKCJIYXBwaW5lc3MiKSsJDQogIHRoZW1lKGxlZ2VuZC5wb3NpdGlvbiA9ICJub25lIikJDQpNb2RlbC5QbG90LkdQQQkNCmBgYA0KDQpMZXQncyBzZWUgd2hhdCBvdXIgY29ycmVsYXRpb25zIGxvb2sgbGlrZSB3aGVuIGx1bXBpbmcgYWxsIHRoZSByaWNoIGFuZCBwb29yIHNjaG9vbHMgdG9nZXRoZXIuDQoNCmBgYHtyfQ0KY29yci5zdHVkZW50ID0gY29yKEFsbC5TY2hvb2xzLkRhdGFbLDE6M10pDQpjb3JycGxvdChjb3JyLnN0dWRlbnQsIG1ldGhvZCA9ICJudW1iZXIiLGRpYWcgPSBGQUxTRSx0eXBlID0gImxvd2VyIikNCmBgYA0KDQpOb3RpY2UgaG93IHRoZSBjb3JyZWxhdGlvbiBiZXR3ZWVuIEZyaWVuZHMgYW5kIEhhcHBpbmVzcyBoYXMgY2hhbmdlZCB3aGVuIHlvdSBjb2xsYXBzZSBhY3Jvc3MgYWxsIHJpY2ggYW5kIHBvb3Igc2Nob29scy4gVGhlIGNvcnJlbGF0aW9uIGlzIG5vdyAuMjQgKHdoaWNoIGlzIGJldHdlZW4gUmljaCBhbmQgUG9vciBzY2hvb2xzKS4gSXQgaXMgYSBwb3NpdGl2ZSBjb3JyZWxhdGlvbiBhcyB3ZWxsLCBidXQgb25seSBwb29yIHNjaG9vbHMgKHRob3NlIHdpdGggbW9yZSBzdHVkZW50cykgaGFkIGEgcG9zaXRpdmUgY29ycmVsYXRpb24uDQpBbHNvIG5vdGljZSB0aGF0IHRoZSBjb3JyZWxhdGlvbiBiZXR3ZWVuIEdQQSBhbmQgSGFwcGluZXNzIGlzIC4wNSwgd2hpY2ggaXMgdGhlIHNhbWUgYXMgZm9yIHRoZSByaWNoIHNjaG9vbCAtIHRoZSBvbmx5IG9uZSB0aGF0IGhhZCBzaG93ZWQgYSBjb3JyZWxhdGlvbi4gDQoNCg0KIyBSZWd1bGFyIFJlZ3Jlc3Npb24NCg0KIyMgQWxsIERhdGENCkxldCdzIHRyeSBydW5uaW5nIGEgbm9ybWFsIHJlZ3Jlc3Npb24gb24gYWxsIHRoZSBkYXRhIGF0IG9uY2UuDQoNCkZpcnN0LCBsZXQncyBjZW50ZXIgdGhlIHZhcmlhYmxlcy4NCg0KYGBge3J9DQpBbGwuU2Nob29scy5EYXRhJEZyaWVuZHMuQzwtc2NhbGUoQWxsLlNjaG9vbHMuRGF0YSRGcmllbmRzLCBzY2FsZSA9IEZBTFNFKVssXQ0KQWxsLlNjaG9vbHMuRGF0YSRHUEEuQzwtc2NhbGUoQWxsLlNjaG9vbHMuRGF0YSRHUEEsIHNjYWxlID0gRkFMU0UpWyxdDQpgYGANCg0KTm93IHdlIGNhbiBydW4gdGhlIHJlZ3Jlc3Npb24uDQoNCmBgYHtyfQ0KUmVnLk1vZGVsPC1sbShIYXBwaW5lc3MgfiBGcmllbmRzLkMgKyBHUEEuQywgZGF0YSA9IEFsbC5TY2hvb2xzLkRhdGEpDQpzdW1tYXJ5KFJlZy5Nb2RlbCkNCiNwbG90KFJlZy5Nb2RlbCkNCmBgYA0KDQpQdXR0aW5nIGFsbCBzY2hvb2xzIHRvZ2V0aGVyIGluIGEgcmVndWxhciByZWdyZXNzaW9uLCB3ZSBoYXZlIGEgcG9zaXRpdmUsIHNpZ25pZmljYW50IGVmZmVjdCBvZiBGcmllbmRzIGFuZCBubyBlZmZlY3Qgb2YgR1BBLiBCdXQgd2hhdCBoYXBwZW5zIHdoZW4gd2Ugc2VwYXJhdGUgdGhlIHNjaG9vbHMgYnkgcmljaCBvciBwb29yIHN0YXR1cz8NCg0KIyMgQnkgU2Nob29sDQpOb3cgbGV0J3Mgc2VlIHdoYXQgaGFwcGVucyBpZiB5b3UgcnVuIGEgbm9ybWFsIHJlZ3Jlc3Npb24gb24gcmljaCBhbmQgcG9vciBzY2hvb2xzIHNlcGFyYXRlbHkuDQoNCmBgYHtyfQ0KIyBSaWNoIFNjaG9vbHMNClNjaG9vbC5SaWNoLlJlZy5Nb2RlbDwtbG0oSGFwcGluZXNzIH4gRnJpZW5kcy5DICsgR1BBLkMsIGRhdGEgPSBzdWJzZXQoQWxsLlNjaG9vbHMuRGF0YSwgU2Nob29sPDQpKQ0Kc3VtbWFyeShTY2hvb2wuUmljaC5SZWcuTW9kZWwpDQpgYGANCg0KTm90aWNlLCB3ZSBoYXZlIGEgbmVnYXRpdmUsIHNpZ25pZmljYW50IGVmZmVjdCBmb3IgRnJpZW5kcyBidXQgbm8gZWZmZWN0IGZvciBHUEEuDQoNCmBgYHtyfQ0KIyBQb29yIFNjaG9vbHMNClNjaG9vbC5Qb29yLlJlZy5Nb2RlbDwtbG0oSGFwcGluZXNzIH4gRnJpZW5kcy5DICsgR1BBLkMsIGRhdGEgPSBzdWJzZXQoQWxsLlNjaG9vbHMuRGF0YSwgU2Nob29sPjMpKQ0Kc3VtbWFyeShTY2hvb2wuUG9vci5SZWcuTW9kZWwpDQpgYGANCg0KVWgtb2guIE5vdyB3ZSBoYXZlIGEgcG9zaXRpdmUsIHNpZ25pZmljYW50IGVmZmVjdCBvZiBGcmllbmRzIGFuZCBubyBlZmZlY3Qgb2YgR1BBLg0KDQojIyBXaGF0J3MgdGhlIHByb2JsZW0/DQoNClJlbWVtYmVyISBBbHRob3VnaCBJIGFtIHRlbGxpbmcgeW91IHRoYXQgc29tZSBzY2hvb2xzIGFyZSByaWNoIGFuZCBzb21lIGFyZSBwb29yLCB5b3UgbWF5IG5vdCBrbm93IHRoaXMgaW5mb3JtYXRpb24gd2hlbiB5b3UgY29tZSBpbiBhbmQgdHJ5IHRvIGRvIHRoZSBhbmFseXNpcy4gSWYgd2Uga25ldyB0aGlzIGluZm9ybWF0aW9uLCB3ZSBjb3VsZCBwdXQgU0VTIGFzIGFub3RoZXIgTGV2ZWwgMiBwcmVkaWN0b3IuIEFsc28sIEkgYW0gb25seSB1c2luZyBzaXggc2Nob29scyB0byBkZW1vbnN0cmF0ZSwgYnV0IGluIGEgbW9yZSAibm9ybWFsIiBjYXNlIG9mIG5lc3RlZCBkZXNpZ24gdGhlcmUgbWF5IGJlIHdheSB0b28gbWFueSBzY2hvb2xzIHRvIHRyZWF0IFNFUyBhcyBhIGZpeGVkIGZhY3RvciBpbiB0aGUgZGVzaWduLg0KDQpUaGUgcmVndWxhciByZWdyZXNzaW9uIGRpZCBub3QgcmVmbGVjdCB3aGF0IHdhcyBoYXBwZW5pbmcgaW4gZWFjaCBzY2hvb2wgdHlwZS4gSXQgZ2F2ZSB1cyBhIHBvc2l0aXZlIGVmZmVjdCAoRnJpZW5kcykgd2hlbiBvbmx5IHBvb3Igc2Nob29scyBoYWQgYSBwb3NpdGl2ZSBlZmZlY3QuIENvbGxhcHNpbmcgYWNyb3NzIHNjaG9vbCB0eXBlcyBpbiB0aGlzIGNhc2Ugd2FzIG5vdCBpZGVhbCBiZWNhdXNlIGRpZmZlcmVudCB0aGluZ3Mgd2VyZSBoYXBwZW5pbmcgd2l0aGluIGVhY2ggc2Nob29sIHR5cGUsIGNvbXByb21pc2luZyB0aGUgZ2VuZXJhbGl6YWJpbGl0eSBvZiB0aGUgZmluZGluZ3MuDQoNCkFub3RoZXIgd2F5IHRvIHB1dCB0aGlzLCB0aGUgcmVndWxhciAobG0pIHJlZ3Jlc3Npb24gaW5kaWNhdGVzIHRoYXQgdGhlIG1vcmUgZnJpZW5kcyBhIHN0dWRlbnQgaGFzLCB0aGUgaGFwcGllciB0aGV5IGFyZSwgYnV0IGxvb2tpbmcgY2xvc2VyIHRoaXMgaXMgbm90IHRoZSBjYXNlIGluIGFsbCBzY2hvb2xzIChhbmQgaXMsIGluIGZhY3QsIHRoZSBvcHBvc2l0ZSBpbiBzb21lKS4gSWYgeW91IHdlcmUgdHJ5aW5nIHRvIGdlbmVyYWxpemUgeW91ciBmaW5kaW5ncyBvciB1c2UgdGhlbSB0byBhcmd1ZSBmb3Ivc2hvdyBhIG5lZWQgZm9yIGFuIGludGVydmVudGlvbiwgeW91ciByZXN1bHRzIHdvdWxkIGJlIG1pc2xlYWRpbmcgYW5kIGNvdWxkIGNhdXNlIHByb2JsZW1zLiANCg0KU08sDQpMZXQncyB0cnkgcnVubmluZyB0aGlzIGFzIGEgbXVsdGlsZXZlbCwgcmFuZG9tIGVmZmVjdHMgbW9kZWw6DQoNCg0KIyBSYW5kb20gRWZmZWN0cyBNb2RlbA0KDQpVc2luZyBhIG11bHRpLWxldmVsIG1vZGVsIGFsbG93cyB1cyB0byBzZXBhcmF0ZSB0aGUgd2l0aGluLWdyb3VwIGVmZmVjdHMgZnJvbSB0aGUgYmV0d2Vlbi1ncm91cCBlZmZlY3RzLCB3aGVyZWFzIHJlZ3VsYXIgcmVncmVzc2lvbiBibGVuZHMgdGhlbSB0b2dldGhlciBpbnRvIGEgc2luZ2xlIGNvZWZmaWNpZW50LiANCg0KDQojIyBSdW5uaW5nIHRoZSBSYW5kb20gRWZmZWN0cyBNb2RlbCANCg0KDQojIyMgRmlyc3QsIHdlIHJ1biB0aGUgbnVsbCBtb2RlbC4NCg0KYGBge3J9DQpOdWxsPC1sbWVyKEhhcHBpbmVzcyB+IDEgIyBUaGlzIHNpbXBseSBtZWFucyBIYXBwaW5lc3MgcHJlZGljdGVkIGJ5IHRoZSBpbnRlcmNlcHQNCiAgICAgICAgICAgICAgICAgICsoMXxTY2hvb2wpLCAjIGVhY2ggc2Nob29sIGdldHMgaXRzIG93biBpbnRlcmNlcHQgDQogICAgICAgICAgICAgICAgICBkYXRhPUFsbC5TY2hvb2xzLkRhdGEsIFJFTUwgPSBGQUxTRSkNCnN1bW1hcnkoTnVsbCkNCmBgYA0KDQpXZSBleGFtaW5lIHRoZSBpbnRyYS1jbGFzcyBjb3JyZWxhdGlvbiAoSUNDKSB0byBkZXRlcm1pbmUgaWYgbXVsdGktbGV2ZWwgbW9kZWxpbmcgaXMgdGhlIGNvcnJlY3QgY2hvaWNlIGZvciBvdXIgYW5hbHlzaXMuIFRoZSBJQ0MgbWVhc3VyZXMgdGhlIGRlZ3JlZSBvZiBjbHVzdGVyaW5nIGluIG91ciBkYXRhIGFuZCBhbnN3ZXJzIHRoZSBxdWVzdGlvbiwgIkhvdyBtdWNoIGRvZXMgbXkgTGV2ZWwgMiBwcmVkaWN0IHRoZSB0b3RhbCB2YXJpYW5jZSBvZiBteSBzdHVkeT8iIElmIHlvdXIgSUNDIGlzIGdyZWF0ZXIgdGhhbiAwLCB5b3UgaGF2ZSBhIG11bHRpLWxldmVsIHN0dWR5LiANCg0KYGBge3J9DQpJQ0MuTW9kZWw8LWZ1bmN0aW9uKE1vZGVsLk5hbWUpIHsNCiAgdGF1Lk51bGw8LWFzLm51bWVyaWMobGFwcGx5KHN1bW1hcnkoTW9kZWwuTmFtZSkkdmFyY29yLCBkaWFnKSkNCiAgc2lnbWEuTnVsbCA8LSBhcy5udW1lcmljKGF0dHIoc3VtbWFyeShNb2RlbC5OYW1lKSR2YXJjb3IsICJzYyIpXjIpDQogIElDQy5OdWxsIDwtIHRhdS5OdWxsLyh0YXUuTnVsbCtzaWdtYS5OdWxsKQ0KICByZXR1cm4oSUNDLk51bGwpDQp9DQoNCklDQy5Nb2RlbChOdWxsKQ0KYGBgDQoNCk91ciBJQ0MgaXMgZ3JlYXRlciB0aGFuIDAsIG1lYW5pbmcgd2Ugd2VyZSBjb3JyZWN0IHRvIHRoaW5rIG9mIHRoaXMgYXMgYSBtdWx0aS1sZXZlbCBwcm9ibGVtLg0KDQoNCiMjIyBOZXh0LCB3ZSBydW4gdGhlIExldmVsIDEgcHJlZGljdG9yIChHUEEpLg0KDQpgYGB7cn0NClRoZS5Nb2RlbC4xPC1sbWVyKEhhcHBpbmVzcyB+IEdQQS5DIA0KICAgICAgICAgICAgICAgICAgKygxfFNjaG9vbCksDQogICAgICAgICAgICAgICAgZGF0YT1BbGwuU2Nob29scy5EYXRhLCBSRU1MID0gRkFMU0UpDQpzdW1tYXJ5KFRoZS5Nb2RlbC4xKQ0KYGBgDQoNClRoZSByZXN1bHRzIGluZGljYXRlIHRoYXQgYSBzdHVkZW50J3MgR1BBIGRvZXMgbm90IGhhdmUgYW4gZWZmZWN0IG9uIHRoZWlyIEhhcHBpbmVzcyB3aGVuIGNvbnRyb2xsaW5nIGZvciBMZXZlbCAyIGZsdWN0dWF0aW9ucyBpbiBIYXBwaW5lc3MuIA0KDQoNCiMjIyBGaW5hbGx5LCB3ZSBydW4gdGhlIExldmVsIDIgcHJlZGljdG9yIChGcmllbmRzKS4NCg0KVGhpcyBtb2RlbCBhbGxvd3MgdGhlIHZhcmlhYmxlIEZyaWVuZHMgdG8gdmFyeSBiZXR3ZWVuIHNjaG9vbHMuDQoNCg0KYGBge3J9DQpUaGUuTW9kZWwuMjwtbG1lcihIYXBwaW5lc3MgfiBGcmllbmRzLkMgKyBHUEEuQyANCiAgICAgICAgICAgICAgICAgICsoMStGcmllbmRzLkN8U2Nob29sKSwgIyBlYWNoIHNjaG9vbCBnZXRzIGl0cyBvd24gaW50ZXJjZXB0LCBhbmQgRnJpZW5kcyBjYW4gdmFyeSBhcyBhIGZ1bmN0aW9uIG9mIHRoZSBzY2hvb2wuDQogICAgICAgICAgICAgICAgZGF0YT1BbGwuU2Nob29scy5EYXRhLCBSRU1MID0gRkFMU0UpDQpzdW1tYXJ5KFRoZS5Nb2RlbC4yKQ0KYGBgDQoNClRoZSByZXN1bHRzIGluZGljYXRlIHRoYXQgdGhlIG51bWJlciBvZiBGcmllbmRzIGEgc3R1ZGVudCBoYXMgZG9lcyBub3QgaGF2ZSBhbiBlZmZlY3Qgb24gSGFwcGluZXNzIHdoZW4gY29udHJvbGxpbmcgZm9yIHRoZSByYW5kb20gZWZmZWN0cyBvZiBMZXZlbCAyIGluZmx1ZW5jZXMuDQoNCg0KIyMjIFdoYXQgZG8gdGhlIHJlc3VsdHMgbWVhbj8NCg0KSW4gb3VyIHJlZ3VsYXIgKGxtKSByZWdyZXNzaW9uLCBGcmllbmRzIGhhZCBhIHNpZ25pZmljYW50IGVmZmVjdCwgYiA9IDEuNDAgKHAgPCAuMDAxKS4gSG93ZXZlciwgaW4gb3VyIG1peGVkIChsbWVyKSByZWdyZXNzaW9uLCBGcmllbmRzIGhhZCBhIGxhcmdlciAoMi4xNiksIGJ1dCBub24tc2lnbmlmaWNhbnQgZWZmZWN0Lg0KDQpXaHkgaXMgdGhpcyBpbXBvcnRhbnQ/IFRoZSBnb2FsIG9mIG11bHRpLWxldmVsIG1vZGVsaW5nIGlzIHRvIGRyYXcgYSBjb25jbHVzaW9uIGFib3V0IHRoZSBnZW5lcmFsIHNhbXBsZSB0aGF0IHlvdSBoYXZlIHdoaWxlIGNvbnRyb2xsaW5nIGZvciBkaWZmZXJlbmNlcyB5b3UgYXJlIG5vdCB0cnlpbmcgdG8gZXhwbGFpbiAoaW4gdGhpcyBleGFtcGxlLCByaWNoIHZzLiBwb29yKS4gTm90IHByb3Blcmx5IGNvbnRyb2xsaW5nIGZvciB0aGVzZSBkaWZmZXJlbmNlcywgd2hpY2ggeW91IG1heSBvZnRlbiBub3Qga25vdyBhcmUgdGhlcmUsIHdpbGwgaW5jcmVhc2UgeW91ciBjaGFuY2Ugb2YgVHlwZSBJIGVycm9yLiBCZWNhdXNlIHRoZSBlZmZlY3Qgb2YgRnJpZW5kcyB3YXMgZGlmZmVyZW50IGluIGRpZmZlcmVudCBzY2hvb2xzLCBpdCBtYWtlcyBzZW5zZSB0aGF0IHRoZSBtdWx0aS1sZXZlbCBtb2RlbCAoTUxNKSBkaWQgbm90IHNob3cgYSBzaWduaWZpY2FudCBlZmZlY3QuIEluIHRoZSBwcmVzZW50IGV4YW1wbGUsIG91ciBNTE0gZ2F2ZSB1cyBhIG1vcmUgYWNjdXJhdGUgaW50ZXJwcmV0YXRpb24gLSB0aGF0IG5vIG1haW4gZWZmZWN0IG9mIEZyaWVuZHMgZXhpc3RlZCBmb3IgYWxsIHNjaG9vbHMgZ2VuZXJhbGx5LiANCg0KDQojIyBDaGVja2luZyB5b3VyIEFzc3VtcHRpb25zDQoNCkZvciBhIGNvbXByZWhlbnNpdmUgbG9vayBhdCBob3cgdG8gcnVuIGRpYWdub3N0aWNzLCBwbGVhc2Ugc2VlIFtDaGFwdGVyIDEyXShodHRwOi8vYWRlbW9zLnBlb3BsZS51aWMuZWR1L0NoYXB0ZXIxMi5odG1sKSBhbmQgW0NoYXB0ZXIgMThdKGh0dHA6Ly9hZGVtb3MucGVvcGxlLnVpYy5lZHUvQ2hhcHRlcjE4Lmh0bWwpICANCg0KDQojIFAtVmFsdWVzDQoNCipQKi12YWx1ZXMgYXJlIGhvdGx5IGRpc3B1dGVkIGluIE1peGVkIE1vZGVscy4gDQoNCk9uZSBzb2x1dGlvbiBpcyB0byBlc3RpbWF0ZSBkZWdyZWVzIG9mIGZyZWVkb20gdG8gZ2V0IHAtdmFsdWVzLiBTQVMvU1BTUyB1c2VzIFNhdHRlcnRod2FpdGUgYXBwcm94aW1hdGlvbnMuIFRoZXJlIGFyZSBhbHNvIEtlbndhcmQtUm9nZXIgYXBwcm94aW1hdGlvbnMgKHNlZSBXZXN0ZmFsbCwgS2VubnksICYgSnVkZCwgMjAxNCkuIEVpdGhlciBhcmUgYWNjZXB0YWJsZS4gTWFraW5nIGEgbnVtYmVyIG9mIGFzc3VtcHRpb25zLCB0aGVzZSBvdXRwdXRzIHdpbGwgbWlycm9yIHRoZSByZXN1bHRzIG9mIGEgdHJhZGl0aW9uYWwgQU5PVkEgZmFpcmx5IGNsb3NlbHkuIA0KDQppbnN0YWxsLnBhY2thZ2VzKCJsbWVyVGVzdCIpDQoNClRoaXMgaXMgYSBtaXhlZCBtb2RlbCBhZGQtb24gcGFja2FnZSB0byBjYWxjdWxhdGUgcC12YWx1ZXMgYmFzZWQgb24gYSBjZXJ0YWluIHNldCBvZiBhc3N1bXB0aW9ucy4NCkVhY2ggZGRmIGlzIGEgZGlmZmVyZW50IG1ldGhvZCBvZiBhdHRhaW5pbmcgcC12YWx1ZXMsIHNvIHlvdSBjYW4gY2hvb3NlIHdoaWNoIHRvIHJ1bi4gSSBnaXZlIHlvdSB0aHJlZSBleGFtcGxlcyBiZWxvdy4gDQp5b3Ugd2lsbCBuZWVkIHRvIHJlZml0IHRoZSBtb2RlbHMgd2l0aCB0aGUgcGFja2FnZSBgbG1lclRlc3RgIGluc3RhbGxlZCBhbmQgbG9hZGVkLg0KDQpgYGB7cn0NCmxpYnJhcnkobG1lclRlc3QpDQpUaGUuTW9kZWwuMjwtbG1lcihIYXBwaW5lc3MgfiBGcmllbmRzLkMgKyBHUEEuQyANCiAgICAgICAgICAgICAgICAgICsoMStGcmllbmRzLkN8U2Nob29sKSwNCiAgICAgICAgICAgICAgICBkYXRhPUFsbC5TY2hvb2xzLkRhdGEsIFJFTUwgPSBGQUxTRSkNCg0Kc3VtbWFyeShUaGUuTW9kZWwuMixkZGYgPSAibG1lNCIpDQpzdW1tYXJ5KFRoZS5Nb2RlbC4yLCBkZGYgPSAiU2F0dGVydGh3YWl0ZSIpICMgU0FTIG1ldGhvZA0KYGBgDQoNCklmIHlvdSB3YW50IHRvIHJlcG9ydCBtYWluIGVmZmVjdHMgYW5kIGludGVyYWN0aW9ucyBpbnN0ZWFkIG9mIHNsb3BlcywgeW91IG1pZ2h0IGNvbnZlcnQgeW91ciBtaXhlZCBtb2RlbCBpbnRvIGFuIEFOT1ZBLg0KDQpgYGB7cn0NCmFub3ZhKFRoZS5Nb2RlbC4yLGRkZiA9ICJLZW53YXJkLVJvZ2VyIikgIyBLZW5ueSBldCBhbCBzdWdnZXN0ZWQgbWV0aG9kDQpgYGANCg0KIyBSZWZlcmVuY2VzDQoNCkh1dGEsIFYuICgyMDE0KS4gV2hlbiB0byB1c2UgaGllcmFyY2hpY2FsIGxpbmVhciBtb2RlbGluZy4gVGhlIFF1YW50aXRhdGl2ZSBNZXRob2RzIGZvciBQc3ljaG9sb2d5LCAxMCgxKTogMTMtIDI4Lg0KDQpXZXN0ZmFsbCwgSi4sIEtlbm55LCBELiBBLiwgJiBKdWRkLCBDLiBNLiAoMjAxNCkuIFN0YXRpc3RpY2FsIHBvd2VyIGFuZCBvcHRpbWFsIGRlc2lnbiBpbiBleHBlcmltZW50cyBpbiB3aGljaCBzYW1wbGVzIG9mIHBhcnRpY2lwYW50cyByZXNwb25kIHRvIHNhbXBsZXMgb2Ygc3RpbXVsaS4gSm91cm5hbCBvZiBFeHBlcmltZW50YWwgUHN5Y2hvbG9neTogR2VuZXJhbCwgMTQzKDUpLCAyMDIwLTIwNDUuDQoNCldvbHRtYW4sIEguLCBGZWxkc3RhaW4sIEEuLCBNYWNLYXksIEouIEMuLCAmIFJvY2NoaSwgTS4gKDIwMTIpLiBBbiBpbnRyb2R1Y3Rpb24gdG8gaGllcmFyY2hpY2FsIGxpbmVhciBtb2RlbGluZy4gVHV0b3JpYWxzIGluIFF1YW50aXRhdGl2ZSBNZXRob2RzIGZvciBQc3ljaG9sb2d5LCA4KDEpOiA1Mi02OS4NCg0KDQo8c2NyaXB0Pg0KICAoZnVuY3Rpb24oaSxzLG8sZyxyLGEsbSl7aVsnR29vZ2xlQW5hbHl0aWNzT2JqZWN0J109cjtpW3JdPWlbcl18fGZ1bmN0aW9uKCl7DQogIChpW3JdLnE9aVtyXS5xfHxbXSkucHVzaChhcmd1bWVudHMpfSxpW3JdLmw9MSpuZXcgRGF0ZSgpO2E9cy5jcmVhdGVFbGVtZW50KG8pLA0KICBtPXMuZ2V0RWxlbWVudHNCeVRhZ05hbWUobylbMF07YS5hc3luYz0xO2Euc3JjPWc7bS5wYXJlbnROb2RlLmluc2VydEJlZm9yZShhLG0pDQogIH0pKHdpbmRvdyxkb2N1bWVudCwnc2NyaXB0JywnaHR0cHM6Ly93d3cuZ29vZ2xlLWFuYWx5dGljcy5jb20vYW5hbHl0aWNzLmpzJywnZ2EnKTsNCg0KICBnYSgnY3JlYXRlJywgJ1VBLTk4ODc4NzkzLTEnLCAnYXV0bycpOw0KICBnYSgnc2VuZCcsICdwYWdldmlldycpOw0KDQo8L3NjcmlwdD4NCg0K, A Language, not a Letter: Learning Statistics in R. install.packages(“lme4”) # Allows you to fit linear mixed-effects models.
Lca Vs Newman, Flats To Rent In Florida Road Durban, Craigslist Bemidji Miscellaneous, Practical Astronomy With Your Calculator Pdf, Wilmington Nc Tv Market, Stub Meaning In Tagalog, Nascar Heat 4 Career Mode Sponsors,