Once we have our \(cell \times genes\) counts matrix, we want to import it in R for analysis.

To store and manipulate our data in R, we are going to use the SingleCellExperiment class (from the SingleCellExperiment package). This class implements a data structure that stores all aspects of our single-cell data: gene-by-cell expression data, per-cell metadata and per-gene annotation and manipulate them in a synchronized manner.

This object is used by most of the single-cell package on Bioconductor.

1 Loading data

Single-cell RNA Seq counts contains a loot of zeros, to save space we can use the sparceMatrix object provided by the Matrix package.

You can use the read_count_output() function to load kb output into a sparceMatrix, and the SingleCellExperiment() to create a SingleCellExperiment object.

# read counts (generate a sparse matrix)
res_mat <- BUSpaRse::read_count_output(
  dir = "results/hgmm_1k/genecount",
  name = "genes",
  tcc = FALSE)
dim(res_mat)

# build SingleCellExperiment (take 9GB of RAM without sparse matrix)
sce <- SingleCellExperiment(
      assays = list(
          counts = res_mat 
      )
  )
counts(sce) %>% head()
rm(res_mat)

The number of genes is as expected for two species. There are way more cells than we expect, which is about 1000. So what’s going on?

2 Data Annotations

When we analyze genes, we want to record summary and information about them. The SingleCellExperiment has the rowData slot containing a DataFrame where each row corresponds to a gene and contains annotations like the transcript length or gene symbol.

From the tr2g table add the usual genes_-name information to your sce object. Then add a species column that tells us if a gene is from the Homo sapiens or the Mus musculs genome.

tr2g <- read_tsv("/data/share/MADT/TP_lmodolo/data/t2g.txt", col_names = c("transcript", "gene", "gene_name"))
rowData(sce) <- DataFrame(
  genes_id = rownames(sce),
  genes_names = tr2g$gene_name[match(rownames(sce), tr2g$gene)],
  species = ifelse(str_detect(rownames(sce), "^ENSMUSG"),
                        "Mus musculus", "Homo sapiens")
)
rowData(sce)

table(rowData(sce)$species %in% "Mus musculus")

We can also annotate genomic transcript from the Annotation Hub. You can use the AnnotationHub() and mapIds() function to extract the chromosomic positions of your transcripts.

hub_infos <- AnnotationHub()

hub_ids <- mcols(hub_infos) %>%
  data.frame() %>% 
  rownames_to_column(var = "id") %>% # we keep the rownames
  as_tibble() %>% 
  dplyr::filter(
    dataprovider %in% "Ensembl" & # Ensembl annotation
    species %in% c("Homo sapiens", "Mus musculus"), # for the two species we want
    genome %in% c("GRCh38", "GRCm38"), # on the right genome
    str_detect(title, "99"), # on the right revision
    rdataclass %in% "EnsDb",
  ) %>% 
  dplyr::select(id, species)

pull_loc <- function(id, hub_infos){
  mapIds(
  hub_infos[[id]],
  keys = str_replace(rowData(sce)$genes_id, "(.*)\\..*", "\\1"),
  keytype = "GENEID",
  column = "SEQNAME")
}

merge_loc <- function(id, hub_infos){
  sapply(id %>% pull(id), pull_loc, hub_infos) %>% 
    as_tibble() %>% 
    unite(col = "chr_pos", na.rm = TRUE) %>% 
    pull(chr_pos)
}

rowData(sce)$chr_pos = merge_loc(hub_ids, hub_infos)
rowData(sce)$is_genomic <- rowData(sce)$chr_pos %in% c(as.character(1:22), "X", "Y")

For cells-level information, we have the colData slot. We can use the gene_species to assign a species to a cell. If a given cell has more than 90% of it’s expressed genes annotated as Homo sapiens were going to annotate it as an Homo sapiens cell. We use the same rule for Mus musculus cells. The rest of the cells are annotated as mixed

dim(counts(sce))
colData(sce) <- DataFrame(
  n_mm_umi = colSums(counts(sce)[rowData(sce)$species %in% "Mus musculus", ]),
  n_hg_umi = colSums(counts(sce)[rowData(sce)$species %in% "Homo sapiens", ]),
  n_umi = colSums(counts(sce))
  )
colData(sce)$species <- colData(sce) %>% 
  as_tibble() %>% 
  mutate(
    prop_mm = n_mm_umi / n_umi,
    prop_hg = n_hg_umi / n_umi,
    species = case_when(
      prop_mm > 0.9 ~ "Mus musculus",
      prop_hg > 0.9 ~ "Homo sapiens",
      TRUE ~ "mixed"
    )
  ) %>% pull(species)
colData(sce)

colData(sce) %>%
  as_tibble() %>% 
  summary()

# save(sce, file = "sce_singecellexperiment.Rdata")

Loots of cells have zeros counts…

Next

LS0tCnRpdGxlOiAic2NSTkEtc2VxOiBzaW5nbGUtY2VsbCBleHBlcmltZW50IgphdXRob3I6IExhdXJlbnQgTW9kb2xvCmRhdGU6IDIwMjEtMjAyMgpvdXRwdXQ6CiAgICBodG1sX25vdGVib29rOgogICAgICB0b2M6IHRydWUKICAgICAgdG9jX2Zsb2F0OgogICAgICAgIGNvbGxhcHNlZDogZmFsc2UKICAgICAgICBzbW9vdGhfc2Nyb2xsOiBmYWxzZQogICAgICBudW1iZXJfc2VjdGlvbnM6IHRydWUKICAgICAgdGhlbWU6IHNhbmRzdG9uZQogICAgICBoaWdobGlnaHQ6IHB5Z21lbnRzCi0tLQoKYGBge3Igc2V0dXAsIGluY2x1ZGU9Rn0Ka25pdHI6Om9wdHNfY2h1bmskc2V0KAogIGV2YWwgPSBGLAogIGVjaG8gPSBULAogIHdhcm5pbmcgPSBGLAogIG1lc3NhZ2UgPSBGLAogIGNhY2hlID0gVCwKICByb290LmRpciA9ICIuLiIsCiAgZml0LndpZHRoID0gMTAsCiAgZmlnLmhlaWdodCA9IDUsCiAgZmlnLnBhdGggPSAnLi9pbWcvJywKICBkcGkgPSAxMDAsCiAgcHJvZ3Jlc3MgPSBUUlVFCikKYGBgCgpPbmNlIHdlIGhhdmUgb3VyICRjZWxsIFx0aW1lcyBnZW5lcyQgY291bnRzIG1hdHJpeCwgd2Ugd2FudCB0byBpbXBvcnQgaXQgaW4gUiBmb3IgYW5hbHlzaXMuCgpUbyBzdG9yZSBhbmQgbWFuaXB1bGF0ZSBvdXIgZGF0YSBpbiBSLCB3ZSBhcmUgZ29pbmcgdG8gdXNlIHRoZSBgU2luZ2xlQ2VsbEV4cGVyaW1lbnRgIGNsYXNzIChmcm9tIHRoZSBbU2luZ2xlQ2VsbEV4cGVyaW1lbnRdKGh0dHBzOi8vYmlvY29uZHVjdG9yLm9yZy9wYWNrYWdlcy8zLjExL1NpbmdsZUNlbGxFeHBlcmltZW50KSBwYWNrYWdlKS4KVGhpcyBjbGFzcyBpbXBsZW1lbnRzIGEgZGF0YSBzdHJ1Y3R1cmUgdGhhdCBzdG9yZXMgYWxsIGFzcGVjdHMgb2Ygb3VyIHNpbmdsZS1jZWxsIGRhdGE6IGdlbmUtYnktY2VsbCBleHByZXNzaW9uIGRhdGEsIHBlci1jZWxsIG1ldGFkYXRhIGFuZCBwZXItZ2VuZSBhbm5vdGF0aW9uIGFuZCBtYW5pcHVsYXRlIHRoZW0gaW4gYSBzeW5jaHJvbml6ZWQgbWFubmVyLgoKIVtdKC4vaW1nL1NpbmdsZUNlbGxFeHBlcmltZW50LnBuZykKClRoaXMgb2JqZWN0IGlzIHVzZWQgYnkgbW9zdCBvZiB0aGUgc2luZ2xlLWNlbGwgcGFja2FnZSBvbiBCaW9jb25kdWN0b3IuCgojIExvYWRpbmcgZGF0YQoKU2luZ2xlLWNlbGwgUk5BIFNlcSBjb3VudHMgY29udGFpbnMgYSBsb290IG9mIHplcm9zLCB0byBzYXZlIHNwYWNlIHdlIGNhbiB1c2UgdGhlIGBzcGFyY2VNYXRyaXhgIG9iamVjdCBwcm92aWRlZCBieSB0aGUgYE1hdHJpeGAgcGFja2FnZS4KCllvdSBjYW4gdXNlIHRoZSBgcmVhZF9jb3VudF9vdXRwdXQoKWAgZnVuY3Rpb24gdG8gbG9hZCBrYiBvdXRwdXQgaW50byBhIGBzcGFyY2VNYXRyaXhgLCBhbmQgdGhlIGBTaW5nbGVDZWxsRXhwZXJpbWVudCgpYCB0byBjcmVhdGUgYSBgU2luZ2xlQ2VsbEV4cGVyaW1lbnRgIG9iamVjdC4KCmBgYHtyIGtiXzJfc2NleHAsIGRlcGVuZHNvbj0ic2V0dXAiLCBlY2hvID0gVCwgaW5jbHVkZT1UfQojIHJlYWQgY291bnRzIChnZW5lcmF0ZSBhIHNwYXJzZSBtYXRyaXgpCnJlc19tYXQgPC0gQlVTcGFSc2U6OnJlYWRfY291bnRfb3V0cHV0KAogIGRpciA9ICJyZXN1bHRzL2hnbW1fMWsvZ2VuZWNvdW50IiwKICBuYW1lID0gImdlbmVzIiwKICB0Y2MgPSBGQUxTRSkKZGltKHJlc19tYXQpCgojIGJ1aWxkIFNpbmdsZUNlbGxFeHBlcmltZW50ICh0YWtlIDlHQiBvZiBSQU0gd2l0aG91dCBzcGFyc2UgbWF0cml4KQpzY2UgPC0gU2luZ2xlQ2VsbEV4cGVyaW1lbnQoCiAgICAgIGFzc2F5cyA9IGxpc3QoCiAgICAgICAgICBjb3VudHMgPSByZXNfbWF0IAogICAgICApCiAgKQpjb3VudHMoc2NlKSAlPiUgaGVhZCgpCnJtKHJlc19tYXQpCmBgYAoKVGhlIG51bWJlciBvZiBnZW5lcyBpcyBhcyBleHBlY3RlZCBmb3IgdHdvIHNwZWNpZXMuIFRoZXJlIGFyZSB3YXkgbW9yZSBjZWxscyB0aGFuIHdlIGV4cGVjdCwgd2hpY2ggaXMgYWJvdXQgMTAwMC4gU28gd2hhdOKAmXMgZ29pbmcgb24/CgojIERhdGEgQW5ub3RhdGlvbnMKCldoZW4gd2UgYW5hbHl6ZSBnZW5lcywgd2Ugd2FudCB0byByZWNvcmQgc3VtbWFyeSBhbmQgaW5mb3JtYXRpb24gYWJvdXQgdGhlbS4gVGhlIGBTaW5nbGVDZWxsRXhwZXJpbWVudGAgaGFzIHRoZSBgcm93RGF0YWAgc2xvdCBjb250YWluaW5nIGEgYERhdGFGcmFtZWAgd2hlcmUgZWFjaCByb3cgY29ycmVzcG9uZHMgdG8gYSBnZW5lIGFuZCBjb250YWlucyBhbm5vdGF0aW9ucyBsaWtlIHRoZSB0cmFuc2NyaXB0IGxlbmd0aCBvciBnZW5lIHN5bWJvbC4KCkZyb20gdGhlIGB0cjJnYCB0YWJsZSBhZGQgdGhlIHVzdWFsIGBnZW5lc18tbmFtZWAgaW5mb3JtYXRpb24gdG8geW91ciBgc2NlYCBvYmplY3QuClRoZW4gYWRkIGEgYHNwZWNpZXNgIGNvbHVtbiB0aGF0IHRlbGxzIHVzIGlmIGEgZ2VuZSBpcyBmcm9tIHRoZSAqSG9tbyBzYXBpZW5zKiBvciB0aGUgKk11cyBtdXNjdWxzKiBnZW5vbWUuCgpgYGB7ciBzY2VfZ2VuZV9hbm5vdGF0aW9uX3NwLCBkZXBlbmRzb249ImtiXzJfc2NleHAifQp0cjJnIDwtIHJlYWRfdHN2KCIvZGF0YS9zaGFyZS9NQURUL1RQX2xtb2RvbG8vZGF0YS90MmcudHh0IiwgY29sX25hbWVzID0gYygidHJhbnNjcmlwdCIsICJnZW5lIiwgImdlbmVfbmFtZSIpKQpyb3dEYXRhKHNjZSkgPC0gRGF0YUZyYW1lKAogIGdlbmVzX2lkID0gcm93bmFtZXMoc2NlKSwKICBnZW5lc19uYW1lcyA9IHRyMmckZ2VuZV9uYW1lW21hdGNoKHJvd25hbWVzKHNjZSksIHRyMmckZ2VuZSldLAogIHNwZWNpZXMgPSBpZmVsc2Uoc3RyX2RldGVjdChyb3duYW1lcyhzY2UpLCAiXkVOU01VU0ciKSwKICAgICAgICAgICAgICAgICAgICAgICAgIk11cyBtdXNjdWx1cyIsICJIb21vIHNhcGllbnMiKQopCnJvd0RhdGEoc2NlKQoKdGFibGUocm93RGF0YShzY2UpJHNwZWNpZXMgJWluJSAiTXVzIG11c2N1bHVzIikKYGBgCgpXZSBjYW4gYWxzbyBhbm5vdGF0ZSBnZW5vbWljIHRyYW5zY3JpcHQgZnJvbSB0aGUgQW5ub3RhdGlvbiBIdWIuCllvdSBjYW4gdXNlIHRoZSBgQW5ub3RhdGlvbkh1YigpYCBhbmQgYG1hcElkcygpYCBmdW5jdGlvbiB0byBleHRyYWN0IHRoZSBjaHJvbW9zb21pYyBwb3NpdGlvbnMgb2YgeW91ciB0cmFuc2NyaXB0cy4KCmBgYHtyIHNjZV9hbm5vdGF0aW9uX210LCBkZXBlbmRzb249InNjZV9nZW5lX2Fubm90YXRpb25fc3AifQpodWJfaW5mb3MgPC0gQW5ub3RhdGlvbkh1YigpCgpodWJfaWRzIDwtIG1jb2xzKGh1Yl9pbmZvcykgJT4lCiAgZGF0YS5mcmFtZSgpICU+JSAKICByb3duYW1lc190b19jb2x1bW4odmFyID0gImlkIikgJT4lICMgd2Uga2VlcCB0aGUgcm93bmFtZXMKICBhc190aWJibGUoKSAlPiUgCiAgZHBseXI6OmZpbHRlcigKICAgIGRhdGFwcm92aWRlciAlaW4lICJFbnNlbWJsIiAmICMgRW5zZW1ibCBhbm5vdGF0aW9uCiAgICBzcGVjaWVzICVpbiUgYygiSG9tbyBzYXBpZW5zIiwgIk11cyBtdXNjdWx1cyIpLCAjIGZvciB0aGUgdHdvIHNwZWNpZXMgd2Ugd2FudAogICAgZ2Vub21lICVpbiUgYygiR1JDaDM4IiwgIkdSQ20zOCIpLCAjIG9uIHRoZSByaWdodCBnZW5vbWUKICAgIHN0cl9kZXRlY3QodGl0bGUsICI5OSIpLCAjIG9uIHRoZSByaWdodCByZXZpc2lvbgogICAgcmRhdGFjbGFzcyAlaW4lICJFbnNEYiIsCiAgKSAlPiUgCiAgZHBseXI6OnNlbGVjdChpZCwgc3BlY2llcykKCnB1bGxfbG9jIDwtIGZ1bmN0aW9uKGlkLCBodWJfaW5mb3MpewogIG1hcElkcygKICBodWJfaW5mb3NbW2lkXV0sCiAga2V5cyA9IHN0cl9yZXBsYWNlKHJvd0RhdGEoc2NlKSRnZW5lc19pZCwgIiguKilcXC4uKiIsICJcXDEiKSwKICBrZXl0eXBlID0gIkdFTkVJRCIsCiAgY29sdW1uID0gIlNFUU5BTUUiKQp9CgptZXJnZV9sb2MgPC0gZnVuY3Rpb24oaWQsIGh1Yl9pbmZvcyl7CiAgc2FwcGx5KGlkICU+JSBwdWxsKGlkKSwgcHVsbF9sb2MsIGh1Yl9pbmZvcykgJT4lIAogICAgYXNfdGliYmxlKCkgJT4lIAogICAgdW5pdGUoY29sID0gImNocl9wb3MiLCBuYS5ybSA9IFRSVUUpICU+JSAKICAgIHB1bGwoY2hyX3BvcykKfQoKcm93RGF0YShzY2UpJGNocl9wb3MgPSBtZXJnZV9sb2MoaHViX2lkcywgaHViX2luZm9zKQpyb3dEYXRhKHNjZSkkaXNfZ2Vub21pYyA8LSByb3dEYXRhKHNjZSkkY2hyX3BvcyAlaW4lIGMoYXMuY2hhcmFjdGVyKDE6MjIpLCAiWCIsICJZIikKYGBgCgpGb3IgY2VsbHMtbGV2ZWwgaW5mb3JtYXRpb24sIHdlIGhhdmUgdGhlIGBjb2xEYXRhYCBzbG90LgpXZSBjYW4gdXNlIHRoZSBgZ2VuZV9zcGVjaWVzYCB0byBhc3NpZ24gYSBzcGVjaWVzIHRvIGEgY2VsbC4KSWYgYSBnaXZlbiBjZWxsIGhhcyBtb3JlIHRoYW4gOTAlIG9mIGl04oCZcyBleHByZXNzZWQgZ2VuZXMgYW5ub3RhdGVkIGFzICpIb21vIHNhcGllbnMqIHdlcmUgZ29pbmcgdG8gYW5ub3RhdGUgaXQgYXMgYW4gKkhvbW8gc2FwaWVucyogY2VsbC4gV2UgdXNlIHRoZSBzYW1lIHJ1bGUgZm9yICpNdXMgbXVzY3VsdXMqIGNlbGxzLiBUaGUgcmVzdCBvZiB0aGUgY2VsbHMgYXJlIGFubm90YXRlZCBhcyAqbWl4ZWQqCgpgYGB7ciBzY2VfZ2VuZV9hbm5vdGF0aW9uLCBkZXBlbmRzb249InNjZV9hbm5vdGF0aW9uX210In0KZGltKGNvdW50cyhzY2UpKQpjb2xEYXRhKHNjZSkgPC0gRGF0YUZyYW1lKAogIG5fbW1fdW1pID0gY29sU3Vtcyhjb3VudHMoc2NlKVtyb3dEYXRhKHNjZSkkc3BlY2llcyAlaW4lICJNdXMgbXVzY3VsdXMiLCBdKSwKICBuX2hnX3VtaSA9IGNvbFN1bXMoY291bnRzKHNjZSlbcm93RGF0YShzY2UpJHNwZWNpZXMgJWluJSAiSG9tbyBzYXBpZW5zIiwgXSksCiAgbl91bWkgPSBjb2xTdW1zKGNvdW50cyhzY2UpKQogICkKY29sRGF0YShzY2UpJHNwZWNpZXMgPC0gY29sRGF0YShzY2UpICU+JSAKICBhc190aWJibGUoKSAlPiUgCiAgbXV0YXRlKAogICAgcHJvcF9tbSA9IG5fbW1fdW1pIC8gbl91bWksCiAgICBwcm9wX2hnID0gbl9oZ191bWkgLyBuX3VtaSwKICAgIHNwZWNpZXMgPSBjYXNlX3doZW4oCiAgICAgIHByb3BfbW0gPiAwLjkgfiAiTXVzIG11c2N1bHVzIiwKICAgICAgcHJvcF9oZyA+IDAuOSB+ICJIb21vIHNhcGllbnMiLAogICAgICBUUlVFIH4gIm1peGVkIgogICAgKQogICkgJT4lIHB1bGwoc3BlY2llcykKY29sRGF0YShzY2UpCgpjb2xEYXRhKHNjZSkgJT4lCiAgYXNfdGliYmxlKCkgJT4lIAogIHN1bW1hcnkoKQoKIyBzYXZlKHNjZSwgZmlsZSA9ICJzY2Vfc2luZ2VjZWxsZXhwZXJpbWVudC5SZGF0YSIpCmBgYAoKTG9vdHMgb2YgY2VsbHMgaGF2ZSB6ZXJvcyBjb3VudHMuLi4KCj4gW05leHRdKC4vcXVhbGl0eV9jb250cm9sLm5iLmh0bWwpCg==