Unidad 1.1 Bases de datos

class: center, middle, inverse, title-slide

# Unidad 1.1 Bases de datos
## Módulo 1
### 
### Daniel Enrique González Gómez <br/> Universidad Javeriana Cali
### 2021-07-26

---

class: inverse, center

<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>
# Que es Estadística ?
<br/><br/><br/><br/><br/>

--
Análisis de datos para la toma de decisiones
---

## Grupos Probabilidad y Estadística 2021-2 
.pull-left[

|    |  B|  E|
|:---|--:|--:|
|bio |  0|  1|
|civ | 22| 17|
|mec |  8|  0|
|sis |  5|  0|
]
.pull-right[
![](punidad101_files/figure-html/unnamed-chunk-2-1.png)
]

---
## Promedio académico
.pull-left[

![](punidad101_files/figure-html/unnamed-chunk-3-1.png)
]
.pull-right[
![](punidad101_files/figure-html/unnamed-chunk-4-1.png)
]
---

.pull-left[

|            |   value|
|:-----------|-------:|
|Mean        |   4.011|
|Std.Dev     |   0.454|
|Min         |   3.160|
|Q1          |   3.630|
|Median      |   3.970|
|Q3          |   4.340|
|Max         |   4.900|
|MAD         |   0.549|
|IQR         |   0.710|
|CV          |   0.113|
|Skewness    |   0.202|
|SE.Skewness |   0.327|
|Kurtosis    |  -1.051|
|N.Valid     |  53.000|
|Pct.Valid   | 100.000|
]
.pull-right[

![](punidad101_files/figure-html/unnamed-chunk-6-1.png)
]

---

<html>
<div class="container-wrapper-genially" style="position: relative; min-height: 400px; max-width: 100%;"><video class="loader-genially" autoplay="autoplay" loop="loop" playsinline="playsInline" muted="muted" style="position: absolute;top: 45%;left: 50%;transform: translate(-50%, -50%);width: 80px;height: 80px;margin-bottom: 10%"><source src="https://static.genial.ly/resources/panel-loader-low.mp4" type="video/mp4" />Your browser does not support the video tag.</video><div id="5f1ba8da1829700da368b4ab" class="genially-embed" style="margin: 0px auto; position: relative; height: auto; width: 100%;"></div></div><script>(function (d) { var js, id = "genially-embed-js", ref = d.getElementsByTagName("script")[0]; if (d.getElementById(id)) { return; } js = d.createElement("script"); js.id = id; js.async = true; js.src = "https://view.genial.ly/static/embed/embed.js"; ref.parentNode.insertBefore(js, ref); }(document));</script>
</html>

---
# Base de datos

Una base de datos es un conjunto de datos pertenecientes a un mismo contexto y almacenados sistemáticamente para su posterior uso.
<br/>
Wikipedia

Una base de datos en estadística es un conjunto de información relacionada con una población organizada en filas y columnas. Las columnas corresponden a las variables y las filas están relacionadas con los individuos u objetos de estudio.

Existen repositorio de bases de datos para uso general

+ dataset en RStudio

+ [Portal Bases de datos abiertos Colombia](https://www.datos.gov.co/)

+ [Datos Banco mundial](https://datos.bancomundial.org/)

+ [Portal de Datos Abiertos de Esri España](https://opendata.esri.es/)

<br/><br/><br/>
[*] Open Data Barometer : https://opendatabarometer.org/4thedition/report/?lang=es]
---

## Base de datos

### Base datos iris (dataset R)

```r
head(iris)
```

```
##   Sepal.Length Sepal.Width Petal.Length Petal.Width Species
## 1          5.1         3.5          1.4         0.2  setosa
## 2          4.9         3.0          1.4         0.2  setosa
## 3          4.7         3.2          1.3         0.2  setosa
## 4          4.6         3.1          1.5         0.2  setosa
## 5          5.0         3.6          1.4         0.2  setosa
## 6          5.4         3.9          1.7         0.4  setosa
```
Datos de iris (de Fisher o Anderson) 
+ longitud y ancho del sépalo 
+ largo y ancho de pétalos
+ especies: setosa,  versicolor y virginica.

Base de datos estadìsticos : arreglo de filas y columnas (matriz) donde por lo general las columnas representan las variables y las filas los registros de los objetos de estudio

---
# Base de datos

Una base de datos es un conjunto de datos pertenecientes a un mismo contexto y almacenados sistemáticamente para su posterior uso.
<br/>
Wikipedia

Existen repositorio de bases de datos para uso general

+ dataset en RStudio

+ [Portal Bases de datos abiertos Colombia](https://www.datos.gov.co/)

+ [Datos Banco mundial](https://datos.bancomundial.org/)

+ [Portal de Datos Abiertos de Esri España](https://opendata.esri.es/)

<br/><br/><br/>
[*] Open Data Barometer : https://opendatabarometer.org/4thedition/report/?lang=es]
---

## Base de datos

### Base datos iris (dataset R)

```r
DT::datatable(head(iris, 150),fillContainer = FALSE, options = list(pageLength = 8))
```

<div id="htmlwidget-4b3819e00966bfbee855" style="width:100%;height:auto;" class="datatables html-widget"></div>
<script type="application/json" data-for="htmlwidget-4b3819e00966bfbee855">{"x":{"filter":"none","fillContainer":false,"data":[["1","2","3","4","5","6","7","8","9","10","11","12","13","14","15","16","17","18","19","20","21","22","23","24","25","26","27","28","29","30","31","32","33","34","35","36","37","38","39","40","41","42","43","44","45","46","47","48","49","50","51","52","53","54","55","56","57","58","59","60","61","62","63","64","65","66","67","68","69","70","71","72","73","74","75","76","77","78","79","80","81","82","83","84","85","86","87","88","89","90","91","92","93","94","95","96","97","98","99","100","101","102","103","104","105","106","107","108","109","110","111","112","113","114","115","116","117","118","119","120","121","122","123","124","125","126","127","128","129","130","131","132","133","134","135","136","137","138","139","140","141","142","143","144","145","146","147","148","149","150"],[5.1,4.9,4.7,4.6,5,5.4,4.6,5,4.4,4.9,5.4,4.8,4.8,4.3,5.8,5.7,5.4,5.1,5.7,5.1,5.4,5.1,4.6,5.1,4.8,5,5,5.2,5.2,4.7,4.8,5.4,5.2,5.5,4.9,5,5.5,4.9,4.4,5.1,5,4.5,4.4,5,5.1,4.8,5.1,4.6,5.3,5,7,6.4,6.9,5.5,6.5,5.7,6.3,4.9,6.6,5.2,5,5.9,6,6.1,5.6,6.7,5.6,5.8,6.2,5.6,5.9,6.1,6.3,6.1,6.4,6.6,6.8,6.7,6,5.7,5.5,5.5,5.8,6,5.4,6,6.7,6.3,5.6,5.5,5.5,6.1,5.8,5,5.6,5.7,5.7,6.2,5.1,5.7,6.3,5.8,7.1,6.3,6.5,7.6,4.9,7.3,6.7,7.2,6.5,6.4,6.8,5.7,5.8,6.4,6.5,7.7,7.7,6,6.9,5.6,7.7,6.3,6.7,7.2,6.2,6.1,6.4,7.2,7.4,7.9,6.4,6.3,6.1,7.7,6.3,6.4,6,6.9,6.7,6.9,5.8,6.8,6.7,6.7,6.3,6.5,6.2,5.9],[3.5,3,3.2,3.1,3.6,3.9,3.4,3.4,2.9,3.1,3.7,3.4,3,3,4,4.4,3.9,3.5,3.8,3.8,3.4,3.7,3.6,3.3,3.4,3,3.4,3.5,3.4,3.2,3.1,3.4,4.1,4.2,3.1,3.2,3.5,3.6,3,3.4,3.5,2.3,3.2,3.5,3.8,3,3.8,3.2,3.7,3.3,3.2,3.2,3.1,2.3,2.8,2.8,3.3,2.4,2.9,2.7,2,3,2.2,2.9,2.9,3.1,3,2.7,2.2,2.5,3.2,2.8,2.5,2.8,2.9,3,2.8,3,2.9,2.6,2.4,2.4,2.7,2.7,3,3.4,3.1,2.3,3,2.5,2.6,3,2.6,2.3,2.7,3,2.9,2.9,2.5,2.8,3.3,2.7,3,2.9,3,3,2.5,2.9,2.5,3.6,3.2,2.7,3,2.5,2.8,3.2,3,3.8,2.6,2.2,3.2,2.8,2.8,2.7,3.3,3.2,2.8,3,2.8,3,2.8,3.8,2.8,2.8,2.6,3,3.4,3.1,3,3.1,3.1,3.1,2.7,3.2,3.3,3,2.5,3,3.4,3],[1.4,1.4,1.3,1.5,1.4,1.7,1.4,1.5,1.4,1.5,1.5,1.6,1.4,1.1,1.2,1.5,1.3,1.4,1.7,1.5,1.7,1.5,1,1.7,1.9,1.6,1.6,1.5,1.4,1.6,1.6,1.5,1.5,1.4,1.5,1.2,1.3,1.4,1.3,1.5,1.3,1.3,1.3,1.6,1.9,1.4,1.6,1.4,1.5,1.4,4.7,4.5,4.9,4,4.6,4.5,4.7,3.3,4.6,3.9,3.5,4.2,4,4.7,3.6,4.4,4.5,4.1,4.5,3.9,4.8,4,4.9,4.7,4.3,4.4,4.8,5,4.5,3.5,3.8,3.7,3.9,5.1,4.5,4.5,4.7,4.4,4.1,4,4.4,4.6,4,3.3,4.2,4.2,4.2,4.3,3,4.1,6,5.1,5.9,5.6,5.8,6.6,4.5,6.3,5.8,6.1,5.1,5.3,5.5,5,5.1,5.3,5.5,6.7,6.9,5,5.7,4.9,6.7,4.9,5.7,6,4.8,4.9,5.6,5.8,6.1,6.4,5.6,5.1,5.6,6.1,5.6,5.5,4.8,5.4,5.6,5.1,5.1,5.9,5.7,5.2,5,5.2,5.4,5.1],[0.2,0.2,0.2,0.2,0.2,0.4,0.3,0.2,0.2,0.1,0.2,0.2,0.1,0.1,0.2,0.4,0.4,0.3,0.3,0.3,0.2,0.4,0.2,0.5,0.2,0.2,0.4,0.2,0.2,0.2,0.2,0.4,0.1,0.2,0.2,0.2,0.2,0.1,0.2,0.2,0.3,0.3,0.2,0.6,0.4,0.3,0.2,0.2,0.2,0.2,1.4,1.5,1.5,1.3,1.5,1.3,1.6,1,1.3,1.4,1,1.5,1,1.4,1.3,1.4,1.5,1,1.5,1.1,1.8,1.3,1.5,1.2,1.3,1.4,1.4,1.7,1.5,1,1.1,1,1.2,1.6,1.5,1.6,1.5,1.3,1.3,1.3,1.2,1.4,1.2,1,1.3,1.2,1.3,1.3,1.1,1.3,2.5,1.9,2.1,1.8,2.2,2.1,1.7,1.8,1.8,2.5,2,1.9,2.1,2,2.4,2.3,1.8,2.2,2.3,1.5,2.3,2,2,1.8,2.1,1.8,1.8,1.8,2.1,1.6,1.9,2,2.2,1.5,1.4,2.3,2.4,1.8,1.8,2.1,2.4,2.3,1.9,2.3,2.5,2.3,1.9,2,2.3,1.8],["setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","setosa","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","versicolor","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica","virginica"]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th> <\/th>\n      <th>Sepal.Length<\/th>\n      <th>Sepal.Width<\/th>\n      <th>Petal.Length<\/th>\n      <th>Petal.Width<\/th>\n      <th>Species<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"pageLength":8,"columnDefs":[{"className":"dt-right","targets":[1,2,3,4]},{"orderable":false,"targets":0}],"order":[],"autoWidth":false,"orderClasses":false,"lengthMenu":[8,10,25,50,100]}},"evals":[],"jsHooks":[]}</script>

---
### Base de datos estudianes Probabilidad y Estadistica 2021-2

```r
var1=c(4,5,6)
DT::datatable(head(bd0052[var1],53),fillContainer = FALSE, options = list(pageLength = 8))
```

<div id="htmlwidget-9840492d71de75d8c79b" style="width:100%;height:auto;" class="datatables html-widget"></div>
<script type="application/json" data-for="htmlwidget-9840492d71de75d8c79b">{"x":{"filter":"none","fillContainer":false,"data":[["1","2","3","4","5","6","7","8","9","10","11","12","13","14","15","16","17","18","19","20","21","22","23","24","25","26","27","28","29","30","31","32","33","34","35","36","37","38","39","40","41","42","43","44","45","46","47","48","49","50","51","52","53"],["B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","B","E","E","E","E","E","E","E","E","E","E","E","E","E","E","E","E","E","E"],[4.12,3.84,4.25,3.31,3.78,3.52,4.9,4.63,4.39,3.91,3.62,3.99,3.16,3.63,3.49,3.53,3.63,3.88,3.69,3.51,3.64,4.59,4.52,4.89,3.6,3.73,4.34,4.74,4.15,3.58,4.59,4.64,3.78,4.34,3.57,3.78,4.3,4.54,3.83,4.22,4.32,4.4,3.99,3.88,3.45,3.3,4.8,3.97,4.41,3.42,4.18,4.1,4.19],["civ","civ","mec","civ","civ","sis","civ","civ","civ","mec","civ","civ","mec","sis","civ","civ","sis","civ","civ","civ","civ","civ","civ","civ","mec","mec","civ","civ","mec","mec","mec","civ","sis","civ","sis","civ","civ","civ","bio","civ","civ","civ","civ","civ","civ","civ","civ","civ","civ","civ","civ","civ","civ"]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th> <\/th>\n      <th>grupo<\/th>\n      <th>promedio<\/th>\n      <th>programa<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"pageLength":8,"columnDefs":[{"className":"dt-right","targets":2},{"orderable":false,"targets":0}],"order":[],"autoWidth":false,"orderClasses":false,"lengthMenu":[8,10,25,50,100]}},"evals":[],"jsHooks":[]}</script>

---
# Etapas del proceso de datos

[*] Imagen tomada de : https://bitsandbricks.github.io/ciencia_de_datos_gente_sociable/

---

# Importar datos

####  Origen de los datos

+ Encuesta personal (datos primarios)
+ Online
+ Entrevista cara a cara
+ Entrevista telefónica

+ Investigación propia

+ Sistema automático de recolección de datos

+ Fuente externa (datos secundarios)
+ DANE
+ Cámara de Comercio
+ Agremiaciones
+ Bancos de datos abiertos

+ Otros medios...
---

#  Herramientas computacionales

+ Excel
+ SQL
+ Oracle
+ SAS

+ R 
+ RStudio
+ Python

<br/><br/><br/>
Video: Importar datos en R  <br/>
por Rafa Gonzalez Gouveia<br/>
https://youtu.be/Bi0PoYq_gjE

---
## Limpieza de datos

Es importante después de haber importado la base de datos, hacer una revisión de cada una de las variables con el fin de poder detectar:

+ Datos faltantes (NA)

+ Datos anómalos o raros

+ Etiquetas mal colocadas ( minúsculas, MAYÚSCULAS, Titulo...)

Existen metodologías para corregir estos problemas sin afectar la información contenida en la data

---
## Ficha técnica

Las bases de datos debe estar acompañadas de una ficha técnica donde si indican sus principales características :

+ [Ficha tecnica](https://drive.google.com/file/d/1O1eaS8y6olf5o_42ehgDgVZ4q1dganbd/view)

+ [Casos positivos de COVID-19 en Colombia](https://www.datos.gov.co/Salud-y-Protecci-n-Social/Casos-positivos-de-COVID-19-en-Colombia/gt2j-8ykr)

---

## Actividades a realizar
<br/><br/>
**A1 Metodología estadística** : Formular un  problema que le permita  desarrollar un  ejercicio académico durante  el  semestre a través de  la recolección  de información (primaria o secundaria), Ademas deberá establecer los  objetivos y las  variables de  interés , para las  cuales  deberá  identificar el tipo de  variable  y su  escala  de medición.  El resultado  de esta actividad deberá se entregado  en archivo pdf con  nombre: **actividad1.pdf**
<br/><br/><br/>

**A2 Base de datos** : Deberá  buscar una  base de  datos  de su interés  en el  portal  
[https://www.datos.gov.co]({Datos Abiertos Colombia}),  depuarla  y  documentarla  si es  necesario. A partir de la información  recolectada deberá construir la ficha técnica de  la base. El resultado  de esta actividad deberá se entregado  en archivo pdf con  nombre: **actividad2.pdf**
<br/><br/><br/>

**A3 Instalación de R y RStudio** : Para el  desarrollo  de las  actividades del curso deberá instalar las ultimas  versiones  de [\href{https://www.r-project.org/](R CRAN) y de [https://rstudio.com/products/rstudio/download/](RStudio).
	
---
class: inverse
background-image: url("img/pujcali.jpeg")

# <p style="color:black"> Gracias </p>

### <p style="color:black"> Daniel Enrique González Gómez </p>
<br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/><br/>

Imagen tomada de : https://www.javerianacali.edu.co/noticias/la-javeriana-bogota-y-cali-1-de-colombia